nixbot

1this derivation will be built:2  /nix/store/wp893csrqpslh4cc0fx0vfj86mckb7aa-vm-test-run-nixbot-gitlab.drv3Failed to find a machine for remote build!4derivation: wp893csrqpslh4cc0fx0vfj86mckb7aa-vm-test-run-nixbot-gitlab.drv5required (system, features): (aarch64-linux, [kvm, nixos-test])61 available machines:7(systems, maxjobs, supportedFeatures, mandatoryFeatures)8([aarch64-darwin, x86_64-darwin], 8, [big-parallel, recursive-nix], [])9building '/nix/store/wp893csrqpslh4cc0fx0vfj86mckb7aa-vm-test-run-nixbot-gitlab.drv'10vm-test-run-nixbot-gitlab> tribuchet: building on eliza11vm-test-run-nixbot-gitlab> Machine state will be reset. To keep it, pass --keep-machine-state12vm-test-run-nixbot-gitlab> start all VLans13vm-test-run-nixbot-gitlab> (finished: start all VLans, in 0.00 seconds)14vm-test-run-nixbot-gitlab> Test will time out and terminate in 3600 seconds15vm-test-run-nixbot-gitlab> run the VM test script16vm-test-run-nixbot-gitlab> start all VMs17vm-test-run-nixbot-gitlab> gitlab: starting vm18vm-test-run-nixbot-gitlab> gitlab: QEMU running (pid 46)19vm-test-run-nixbot-gitlab> gitlab # Disk image does not exist, creating the virtualisation disk image...20vm-test-run-nixbot-gitlab> gitlab # Formatting '/build/vm-state-gitlab/tmp.G5FaShWvMU', fmt=raw size=107374182421vm-test-run-nixbot-gitlab> gitlab # mke2fs 1.47.4 (6-Mar-2025)22vm-test-run-nixbot-gitlab> (finished: start all VMs, in 70.38 seconds)23vm-test-run-nixbot-gitlab> gitlab # Discarding device blocks:      0/262144             done24vm-test-run-nixbot-gitlab> gitlab: waiting for unit setup-gitlab.service25vm-test-run-nixbot-gitlab> gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes26vm-test-run-nixbot-gitlab> gitlab: waiting for the VM to finish booting27vm-test-run-nixbot-gitlab> gitlab # Filesystem UUID: 3f36ff5e-1e3f-40b4-a9e6-a2d57a8b833628vm-test-run-nixbot-gitlab> gitlab # Superblock backups stored on blocks:29vm-test-run-nixbot-gitlab> gitlab # 	32768, 98304, 163840, 22937630vm-test-run-nixbot-gitlab> gitlab # 31vm-test-run-nixbot-gitlab> gitlab # Allocating group tables: 0/8   done32vm-test-run-nixbot-gitlab> gitlab # Writing inode tables: 0/8   done33vm-test-run-nixbot-gitlab> gitlab # Creating journal (8192 blocks): done34vm-test-run-nixbot-gitlab> gitlab # Writing superblocks and filesystem accounting information: 0/8   done35vm-test-run-nixbot-gitlab> gitlab # 36vm-test-run-nixbot-gitlab> gitlab # Virtualisation disk image created.37vm-test-run-nixbot-gitlab> gitlab # Creating Nix store image...38vm-test-run-nixbot-gitlab> gitlab # Created Nix store image.39vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]40vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug  6 17:27:09 UTC 202641vm-test-run-nixbot-gitlab> gitlab # [    0.000000] KASLR enabled42vm-test-run-nixbot-gitlab> gitlab # [    0.000000] random: crng init done43vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Machine model: linux,dummy-virt44vm-test-run-nixbot-gitlab> gitlab # [    0.000000] efi: UEFI not found.45vm-test-run-nixbot-gitlab> gitlab # [    0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT46vm-test-run-nixbot-gitlab> gitlab # [    0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]47vm-test-run-nixbot-gitlab> gitlab # [    0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]48vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Zone ranges:49vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   DMA      [mem 0x0000000040000000-0x00000000ffffffff]50vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   DMA32    empty51vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   Normal   [mem 0x0000000100000000-0x00000001bfffffff]52vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   Device   empty53vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Movable zone start for each node54vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Early memory node ranges55vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   node   0: [mem 0x0000000040000000-0x00000001bfffffff]56vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]57vm-test-run-nixbot-gitlab> gitlab # [    0.000000] cma: Reserved 32 MiB at 0x00000000fe00000058vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: probing for conduit method from DT.59vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: PSCIv1.3 detected in firmware.60vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: Using standard PSCI v0.2 function IDs61vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: Trusted OS migration not required62vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: SMC Calling Convention v1.163vm-test-run-nixbot-gitlab> gitlab # [    0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)64vm-test-run-nixbot-gitlab> gitlab # [    0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129665vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Detected PIPT I-cache on CPU066vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)67vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: GICv3 CPU interface68vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: Spectre-v469vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: Spectre-BHB70vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3871vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2372vm-test-run-nixbot-gitlab> gitlab # [    0.000000] alternatives: applying boot alternatives73vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/nsc0n24i32a3x9a6f4mbrx2gf4jn0alr-nixos-system-gitlab-test/init regInfo=/nix/store/dxygd5ipryn11ahz8jwcy4bxv4j3z7bf-closure-info/registration console=ttyAMA0,115200n8 console=tty074vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Unknown kernel command line parameters "regInfo=/nix/store/dxygd5ipryn11ahz8jwcy4bxv4j3z7bf-closure-info/registration", will be passed to user space.75vm-test-run-nixbot-gitlab> gitlab # [    0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes76vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)77vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)78vm-test-run-nixbot-gitlab> gitlab # [    0.000000] software IO TLB: area num 4.79vm-test-run-nixbot-gitlab> gitlab # [    0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)80vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Fallback order for Node 0: 081vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 157286482vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Policy zone: Normal83vm-test-run-nixbot-gitlab> gitlab # [    0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off84vm-test-run-nixbot-gitlab> gitlab # [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=185vm-test-run-nixbot-gitlab> gitlab # [    0.000000] allocated 12582912 bytes of page_ext86vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ftrace: allocating 74867 entries in 294 pages87vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ftrace: allocated 294 pages with 4 groups88vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: Hierarchical RCU implementation.89vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: 	RCU event tracing is enabled.90vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.91vm-test-run-nixbot-gitlab> gitlab # [    0.000000] 	Trampoline variant of Tasks RCU enabled.92vm-test-run-nixbot-gitlab> gitlab # [    0.000000] 	Rude variant of Tasks RCU enabled.93vm-test-run-nixbot-gitlab> gitlab # [    0.000000] 	Tracing variant of Tasks RCU enabled.94vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.95vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=496vm-test-run-nixbot-gitlab> gitlab # [    0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.97vm-test-run-nixbot-gitlab> gitlab # [    0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.98vm-test-run-nixbot-gitlab> gitlab # [    0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.99vm-test-run-nixbot-gitlab> gitlab # [    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0100vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: 256 SPIs implemented101vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: 0 Extended SPIs implemented102vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Root IRQ handler: gic_handle_irq103vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI104vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0105vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000106vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ITS [mem 0x08080000-0x0809ffff]107vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)108vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)109vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: using LPI property table @0x0000000100f30000110vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000111vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.112vm-test-run-nixbot-gitlab> gitlab # [    0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns113vm-test-run-nixbot-gitlab> gitlab # [    0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).114vm-test-run-nixbot-gitlab> gitlab # [    0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns115vm-test-run-nixbot-gitlab> gitlab # [    0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns116vm-test-run-nixbot-gitlab> gitlab # [    0.000031] arm-pv: using stolen time PV117vm-test-run-nixbot-gitlab> gitlab # [    0.000385] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)118vm-test-run-nixbot-gitlab> gitlab # [    0.000574] Console: colour dummy device 80x25119vm-test-run-nixbot-gitlab> gitlab # [    0.000582] printk: legacy console [tty0] enabled120vm-test-run-nixbot-gitlab> gitlab # [    0.000762] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)121vm-test-run-nixbot-gitlab> gitlab # [    0.000768] pid_max: default: 32768 minimum: 301122vm-test-run-nixbot-gitlab> gitlab # [    0.000850] LSM: initializing lsm=capability,landlock,yama,bpf,ima123vm-test-run-nixbot-gitlab> gitlab # [    0.001003] landlock: Up and running.124vm-test-run-nixbot-gitlab> gitlab # [    0.001006] Yama: becoming mindful.125vm-test-run-nixbot-gitlab> gitlab # [    0.001427] LSM support for eBPF active126vm-test-run-nixbot-gitlab> gitlab # [    0.001612] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)127vm-test-run-nixbot-gitlab> gitlab # [    0.001713] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)128vm-test-run-nixbot-gitlab> gitlab # [    0.002898] cacheinfo: Unable to detect cache hierarchy for CPU 0129vm-test-run-nixbot-gitlab> gitlab # [    0.003555] rcu: Hierarchical SRCU implementation.130vm-test-run-nixbot-gitlab> gitlab # [    0.003559] rcu: 	Max phase no-delay instances is 1000.131vm-test-run-nixbot-gitlab> gitlab # [    0.003704] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level132vm-test-run-nixbot-gitlab> gitlab # [    0.004754] fsl-mc MSI: its@8080000 domain created133vm-test-run-nixbot-gitlab> gitlab # [    0.004850] EFI services will not be available.134vm-test-run-nixbot-gitlab> gitlab # [    0.005020] smp: Bringing up secondary CPUs ...135vm-test-run-nixbot-gitlab> gitlab # [    0.005669] Detected PIPT I-cache on CPU1136vm-test-run-nixbot-gitlab> gitlab # [    0.005767] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000137vm-test-run-nixbot-gitlab> gitlab # [    0.005891] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000138vm-test-run-nixbot-gitlab> gitlab # [    0.006014] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]139vm-test-run-nixbot-gitlab> gitlab # [    0.007080] Detected PIPT I-cache on CPU2140vm-test-run-nixbot-gitlab> gitlab # [    0.007183] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000141vm-test-run-nixbot-gitlab> gitlab # [    0.007304] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000142vm-test-run-nixbot-gitlab> gitlab # [    0.007427] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]143vm-test-run-nixbot-gitlab> gitlab # [    0.008486] Detected PIPT I-cache on CPU3144vm-test-run-nixbot-gitlab> gitlab # [    0.008599] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000145vm-test-run-nixbot-gitlab> gitlab # [    0.008721] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000146vm-test-run-nixbot-gitlab> gitlab # [    0.008851] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]147vm-test-run-nixbot-gitlab> gitlab # [    0.009383] smp: Brought up 1 node, 4 CPUs148vm-test-run-nixbot-gitlab> gitlab # [    0.009411] SMP: Total of 4 processors activated.149vm-test-run-nixbot-gitlab> gitlab # [    0.009413] CPU: All CPU(s) started at EL1150vm-test-run-nixbot-gitlab> gitlab # [    0.009421] CPU features: detected: Branch Target Identification151vm-test-run-nixbot-gitlab> gitlab # [    0.009425] CPU features: detected: ARMv8.4 Translation Table Level152vm-test-run-nixbot-gitlab> gitlab # [    0.009428] CPU features: detected: Instruction cache invalidation not required for I/D coherence153vm-test-run-nixbot-gitlab> gitlab # [    0.009431] CPU features: detected: Data cache clean to the PoU not required for I/D coherence154vm-test-run-nixbot-gitlab> gitlab # [    0.009435] CPU features: detected: Common not Private translations155vm-test-run-nixbot-gitlab> gitlab # [    0.009437] CPU features: detected: CRC32 instructions156vm-test-run-nixbot-gitlab> gitlab # [    0.009439] CPU features: detected: Data cache clean to Point of Deep Persistence157vm-test-run-nixbot-gitlab> gitlab # [    0.009443] CPU features: detected: Data cache clean to Point of Persistence158vm-test-run-nixbot-gitlab> gitlab # [    0.009446] CPU features: detected: Data independent timing control (DIT)159vm-test-run-nixbot-gitlab> gitlab # [    0.009448] CPU features: detected: E0PD160vm-test-run-nixbot-gitlab> gitlab # [    0.009451] CPU features: detected: Enhanced Counter Virtualization161vm-test-run-nixbot-gitlab> gitlab # [    0.009453] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)162vm-test-run-nixbot-gitlab> gitlab # [    0.009456] CPU features: detected: Enhanced Virtualization Traps163vm-test-run-nixbot-gitlab> gitlab # [    0.009459] CPU features: detected: Fine Grained Traps164vm-test-run-nixbot-gitlab> gitlab # [    0.009462] CPU features: detected: Generic authentication (architected QARMA5 algorithm)165vm-test-run-nixbot-gitlab> gitlab # [    0.009466] CPU features: detected: RCpc load-acquire (LDAPR)166vm-test-run-nixbot-gitlab> gitlab # [    0.009469] CPU features: detected: LSE atomic instructions167vm-test-run-nixbot-gitlab> gitlab # [    0.009472] CPU features: detected: Privileged Access Never168vm-test-run-nixbot-gitlab> gitlab # [    0.009474] CPU features: detected: PMUv3169vm-test-run-nixbot-gitlab> gitlab # [    0.009476] CPU features: detected: RAS Extension Support170vm-test-run-nixbot-gitlab> gitlab # [    0.009479] CPU features: detected: RASv1p1 Extension Support171vm-test-run-nixbot-gitlab> gitlab # [    0.009481] CPU features: detected: Random Number Generator172vm-test-run-nixbot-gitlab> gitlab # [    0.009484] CPU features: detected: Speculation barrier (SB)173vm-test-run-nixbot-gitlab> gitlab # [    0.009486] CPU features: detected: Stage-2 Force Write-Back174vm-test-run-nixbot-gitlab> gitlab # [    0.009489] CPU features: detected: TLB range maintenance instructions175vm-test-run-nixbot-gitlab> gitlab # [    0.009492] CPU features: detected: Speculative Store Bypassing Safe (SSBS)176vm-test-run-nixbot-gitlab> gitlab # [    0.009618] alternatives: applying system-wide alternatives177vm-test-run-nixbot-gitlab> gitlab # [    0.012571] CPU features: detected: BBM Level 2 without TLB conflict abort178vm-test-run-nixbot-gitlab> gitlab # [    0.012829] Memory: 5963804K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)179vm-test-run-nixbot-gitlab> gitlab # [    0.014266] devtmpfs: initialized180vm-test-run-nixbot-gitlab> gitlab # [    0.018200] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)181vm-test-run-nixbot-gitlab> gitlab # [    0.018266] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).182vm-test-run-nixbot-gitlab> gitlab # [    0.018482] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL183vm-test-run-nixbot-gitlab> gitlab # [    0.018487] 0 pages in range for non-PLT usage184vm-test-run-nixbot-gitlab> gitlab # [    0.018488] 508288 pages in range for PLT usage185vm-test-run-nixbot-gitlab> gitlab # [    0.018613] pinctrl core: initialized pinctrl subsystem186vm-test-run-nixbot-gitlab> gitlab # [    0.019405] DMI not present or invalid.187vm-test-run-nixbot-gitlab> gitlab # [    0.022436] NET: Registered PF_NETLINK/PF_ROUTE protocol family188vm-test-run-nixbot-gitlab> gitlab # [    0.025022] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations189vm-test-run-nixbot-gitlab> gitlab # [    0.025310] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations190vm-test-run-nixbot-gitlab> gitlab # [    0.027007] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations191vm-test-run-nixbot-gitlab> gitlab # [    0.027031] audit: initializing netlink subsys (disabled)192vm-test-run-nixbot-gitlab> gitlab # [    0.027334] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1193vm-test-run-nixbot-gitlab> gitlab # [    0.027809] thermal_sys: Registered thermal governor 'fair_share'194vm-test-run-nixbot-gitlab> gitlab # [    0.027812] thermal_sys: Registered thermal governor 'bang_bang'195vm-test-run-nixbot-gitlab> gitlab # [    0.027816] thermal_sys: Registered thermal governor 'step_wise'196vm-test-run-nixbot-gitlab> gitlab # [    0.027819] thermal_sys: Registered thermal governor 'user_space'197vm-test-run-nixbot-gitlab> gitlab # [    0.027822] thermal_sys: Registered thermal governor 'power_allocator'198vm-test-run-nixbot-gitlab> gitlab # [    0.027910] cpuidle: using governor ladder199vm-test-run-nixbot-gitlab> gitlab # [    0.027934] cpuidle: using governor menu200vm-test-run-nixbot-gitlab> gitlab # [    0.028140] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.201vm-test-run-nixbot-gitlab> gitlab # [    0.028352] ASID allocator initialised with 65536 entries202vm-test-run-nixbot-gitlab> gitlab # [    0.029538] Serial: AMBA PL011 UART driver203vm-test-run-nixbot-gitlab> gitlab # [    0.034794] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1204vm-test-run-nixbot-gitlab> gitlab # [    0.035139] printk: console [ttyAMA0] enabled205vm-test-run-nixbot-gitlab> gitlab # [    0.047238] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages206vm-test-run-nixbot-gitlab> gitlab # [    0.047262] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page207vm-test-run-nixbot-gitlab> gitlab # [    0.047272] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages208vm-test-run-nixbot-gitlab> gitlab # [    0.047280] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page209vm-test-run-nixbot-gitlab> gitlab # [    0.047288] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages210vm-test-run-nixbot-gitlab> gitlab # [    0.047296] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page211vm-test-run-nixbot-gitlab> gitlab # [    0.047304] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages212vm-test-run-nixbot-gitlab> gitlab # [    0.047312] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page213vm-test-run-nixbot-gitlab> gitlab # [    0.059140] fbcon: Taking over console214vm-test-run-nixbot-gitlab> gitlab # [    0.059156] ACPI: Interpreter disabled.215vm-test-run-nixbot-gitlab> gitlab # [    0.060337] iommu: Default domain type: Translated216vm-test-run-nixbot-gitlab> gitlab # [    0.060355] iommu: DMA domain TLB invalidation policy: strict mode217vm-test-run-nixbot-gitlab> gitlab # [    0.069955] SCSI subsystem initialized218vm-test-run-nixbot-gitlab> gitlab # [    0.070429] usbcore: registered new interface driver usbfs219vm-test-run-nixbot-gitlab> gitlab # [    0.070459] usbcore: registered new interface driver hub220vm-test-run-nixbot-gitlab> gitlab # [    0.070479] usbcore: registered new device driver usb221vm-test-run-nixbot-gitlab> gitlab # [    0.070897] pps_core: LinuxPPS API ver. 1 registered222vm-test-run-nixbot-gitlab> gitlab # [    0.070901] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>223vm-test-run-nixbot-gitlab> gitlab # [    0.070914] PTP clock support registered224vm-test-run-nixbot-gitlab> gitlab # [    0.070959] EDAC MC: Ver: 3.0.0225vm-test-run-nixbot-gitlab> gitlab # [    0.071508] scmi_core: SCMI protocol bus registered226vm-test-run-nixbot-gitlab> gitlab # [    0.072578] FPGA manager framework227vm-test-run-nixbot-gitlab> gitlab # [    0.077953] vgaarb: loaded228vm-test-run-nixbot-gitlab> gitlab # [    0.078594] clocksource: Switched to clocksource arch_sys_counter229vm-test-run-nixbot-gitlab> gitlab # [    0.079191] VFS: Disk quotas dquot_6.6.0230vm-test-run-nixbot-gitlab> gitlab # [    0.079225] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)231vm-test-run-nixbot-gitlab> gitlab # [    0.081425] netfs: FS-Cache loaded232vm-test-run-nixbot-gitlab> gitlab # [    0.081596] pnp: PnP ACPI: disabled233vm-test-run-nixbot-gitlab> gitlab # [    0.088462] NET: Registered PF_INET protocol family234vm-test-run-nixbot-gitlab> gitlab # [    0.089446] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)235vm-test-run-nixbot-gitlab> gitlab # [    0.117974] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)236vm-test-run-nixbot-gitlab> gitlab # [    0.118031] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)237vm-test-run-nixbot-gitlab> gitlab # [    0.118086] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)238vm-test-run-nixbot-gitlab> gitlab # [    0.118357] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)239vm-test-run-nixbot-gitlab> gitlab # [    0.118977] TCP: Hash tables configured (established 65536 bind 65536)240vm-test-run-nixbot-gitlab> gitlab # [    0.119087] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)241vm-test-run-nixbot-gitlab> gitlab # [    0.119141] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)242vm-test-run-nixbot-gitlab> gitlab # [    0.119254] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)243vm-test-run-nixbot-gitlab> gitlab # [    0.119446] NET: Registered PF_UNIX/PF_LOCAL protocol family244vm-test-run-nixbot-gitlab> gitlab # [    0.119466] NET: Registered PF_XDP protocol family245vm-test-run-nixbot-gitlab> gitlab # [    0.119484] PCI: CLS 0 bytes, default 64246vm-test-run-nixbot-gitlab> gitlab # [    0.119747] Trying to unpack rootfs image as initramfs...247vm-test-run-nixbot-gitlab> gitlab # [    0.131166] kvm [1]: HYP mode not available248vm-test-run-nixbot-gitlab> gitlab # [    0.181294] Initialise system trusted keyrings249vm-test-run-nixbot-gitlab> gitlab # [    0.181807] workingset: timestamp_bits=42 max_order=21 bucket_order=0250vm-test-run-nixbot-gitlab> gitlab # [    0.184085] squashfs: version 4.0 (2009/01/31) Phillip Lougher251vm-test-run-nixbot-gitlab> gitlab # [    0.184299] 9p: Installing v9fs 9p2000 file system support252vm-test-run-nixbot-gitlab> gitlab # [    0.222682] Key type asymmetric registered253vm-test-run-nixbot-gitlab> gitlab # [    0.222693] Asymmetric key parser 'x509' registered254vm-test-run-nixbot-gitlab> gitlab # [    0.222908] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)255vm-test-run-nixbot-gitlab> gitlab # [    0.223217] io scheduler mq-deadline registered256vm-test-run-nixbot-gitlab> gitlab # [    0.223229] io scheduler kyber registered257vm-test-run-nixbot-gitlab> gitlab # [    0.237741] pl061_gpio 9030000.pl061: PL061 GPIO chip registered258vm-test-run-nixbot-gitlab> gitlab # [    0.243018] ledtrig-cpu: registered to indicate activity on CPUs259vm-test-run-nixbot-gitlab> gitlab # [    0.244247] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:260vm-test-run-nixbot-gitlab> gitlab # [    0.244284] pci-host-generic 4010000000.pcie:       IO 0x003eff0000..0x003effffff -> 0x0000000000261vm-test-run-nixbot-gitlab> gitlab # [    0.244312] pci-host-generic 4010000000.pcie:      MEM 0x0010000000..0x003efeffff -> 0x0010000000262vm-test-run-nixbot-gitlab> gitlab # [    0.244331] pci-host-generic 4010000000.pcie:      MEM 0x8000000000..0xffffffffff -> 0x8000000000263vm-test-run-nixbot-gitlab> gitlab # [    0.244383] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits264vm-test-run-nixbot-gitlab> gitlab # [    0.244434] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]265vm-test-run-nixbot-gitlab> gitlab # [    0.244748] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00266vm-test-run-nixbot-gitlab> gitlab # [    0.244769] pci_bus 0000:00: root bus resource [bus 00-ff]267vm-test-run-nixbot-gitlab> gitlab # [    0.244898] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]268vm-test-run-nixbot-gitlab> gitlab # [    0.244910] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]269vm-test-run-nixbot-gitlab> gitlab # [    0.244920] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]270vm-test-run-nixbot-gitlab> gitlab # [    0.245184] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint271vm-test-run-nixbot-gitlab> gitlab # [    0.246745] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint272vm-test-run-nixbot-gitlab> gitlab # [    0.247422] pci 0000:00:01.0: BAR 0 [io  0x0000-0x001f]273vm-test-run-nixbot-gitlab> gitlab # [    0.247460] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]274vm-test-run-nixbot-gitlab> gitlab # [    0.247543] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275vm-test-run-nixbot-gitlab> gitlab # [    0.247581] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]276vm-test-run-nixbot-gitlab> gitlab # [    0.249195] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint277vm-test-run-nixbot-gitlab> gitlab # [    0.249833] pci 0000:00:02.0: BAR 0 [io  0x0000-0x001f]278vm-test-run-nixbot-gitlab> gitlab # [    0.249881] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]279vm-test-run-nixbot-gitlab> gitlab # [    0.249964] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]280vm-test-run-nixbot-gitlab> gitlab # [    0.251638] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint281vm-test-run-nixbot-gitlab> gitlab # [    0.252262] pci 0000:00:03.0: BAR 0 [io  0x0000-0x001f]282vm-test-run-nixbot-gitlab> gitlab # [    0.252298] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]283vm-test-run-nixbot-gitlab> gitlab # [    0.252404] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]284vm-test-run-nixbot-gitlab> gitlab # [    0.254023] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint285vm-test-run-nixbot-gitlab> gitlab # [    0.254661] pci 0000:00:04.0: BAR 0 [io  0x0000-0x001f]286vm-test-run-nixbot-gitlab> gitlab # [    0.254697] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]287vm-test-run-nixbot-gitlab> gitlab # [    0.254796] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]288vm-test-run-nixbot-gitlab> gitlab # [    0.256455] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint289vm-test-run-nixbot-gitlab> gitlab # [    0.257089] pci 0000:00:05.0: BAR 0 [io  0x0000-0x007f]290vm-test-run-nixbot-gitlab> gitlab # [    0.257125] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]291vm-test-run-nixbot-gitlab> gitlab # [    0.257207] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]292vm-test-run-nixbot-gitlab> gitlab # [    0.258916] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint293vm-test-run-nixbot-gitlab> gitlab # [    0.259584] pci 0000:00:06.0: BAR 0 [io  0x0000-0x007f]294vm-test-run-nixbot-gitlab> gitlab # [    0.259620] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]295vm-test-run-nixbot-gitlab> gitlab # [    0.259715] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]296vm-test-run-nixbot-gitlab> gitlab # [    0.261343] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint297vm-test-run-nixbot-gitlab> gitlab # [    0.261971] pci 0000:00:07.0: BAR 0 [io  0x0000-0x001f]298vm-test-run-nixbot-gitlab> gitlab # [    0.262007] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]299vm-test-run-nixbot-gitlab> gitlab # [    0.262091] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]300vm-test-run-nixbot-gitlab> gitlab # [    0.262129] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]301vm-test-run-nixbot-gitlab> gitlab # [    0.263786] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint302vm-test-run-nixbot-gitlab> gitlab # [    0.264422] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]303vm-test-run-nixbot-gitlab> gitlab # [    0.264506] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304vm-test-run-nixbot-gitlab> gitlab # [    0.266140] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint305vm-test-run-nixbot-gitlab> gitlab # [    0.266830] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]306vm-test-run-nixbot-gitlab> gitlab # [    0.266924] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]307vm-test-run-nixbot-gitlab> gitlab # [    0.268276] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint308vm-test-run-nixbot-gitlab> gitlab # [    0.268905] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]309vm-test-run-nixbot-gitlab> gitlab # [    0.269686] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint310vm-test-run-nixbot-gitlab> gitlab # [    0.270405] pci 0000:00:0b.0: BAR 0 [io  0x0000-0x003f]311vm-test-run-nixbot-gitlab> gitlab # [    0.270441] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]312vm-test-run-nixbot-gitlab> gitlab # [    0.270524] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]313vm-test-run-nixbot-gitlab> gitlab # [    0.272067] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint314vm-test-run-nixbot-gitlab> gitlab # [    0.272664] pci 0000:00:0c.0: BAR 0 [io  0x0000-0x001f]315vm-test-run-nixbot-gitlab> gitlab # [    0.272701] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]316vm-test-run-nixbot-gitlab> gitlab # [    0.272786] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]317vm-test-run-nixbot-gitlab> gitlab # [    0.274731] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned318vm-test-run-nixbot-gitlab> gitlab # [    0.274750] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned319vm-test-run-nixbot-gitlab> gitlab # [    0.274761] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned320vm-test-run-nixbot-gitlab> gitlab # [    0.274901] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned321vm-test-run-nixbot-gitlab> gitlab # [    0.275040] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned322vm-test-run-nixbot-gitlab> gitlab # [    0.275181] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned323vm-test-run-nixbot-gitlab> gitlab # [    0.275346] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned324vm-test-run-nixbot-gitlab> gitlab # [    0.275491] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned325vm-test-run-nixbot-gitlab> gitlab # [    0.275628] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned326vm-test-run-nixbot-gitlab> gitlab # [    0.275791] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned327vm-test-run-nixbot-gitlab> gitlab # [    0.275930] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned328vm-test-run-nixbot-gitlab> gitlab # [    0.276072] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned329vm-test-run-nixbot-gitlab> gitlab # [    0.276259] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned330vm-test-run-nixbot-gitlab> gitlab # [    0.276414] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned331vm-test-run-nixbot-gitlab> gitlab # [    0.276482] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned332vm-test-run-nixbot-gitlab> gitlab # [    0.276537] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned333vm-test-run-nixbot-gitlab> gitlab # [    0.276594] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned334vm-test-run-nixbot-gitlab> gitlab # [    0.276650] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned335vm-test-run-nixbot-gitlab> gitlab # [    0.276708] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned336vm-test-run-nixbot-gitlab> gitlab # [    0.276767] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned337vm-test-run-nixbot-gitlab> gitlab # [    0.276823] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned338vm-test-run-nixbot-gitlab> gitlab # [    0.276890] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned339vm-test-run-nixbot-gitlab> gitlab # [    0.276950] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned340vm-test-run-nixbot-gitlab> gitlab # [    0.277009] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned341vm-test-run-nixbot-gitlab> gitlab # [    0.277067] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned342vm-test-run-nixbot-gitlab> gitlab # [    0.277121] pci 0000:00:05.0: BAR 0 [io  0x1000-0x107f]: assigned343vm-test-run-nixbot-gitlab> gitlab # [    0.277176] pci 0000:00:06.0: BAR 0 [io  0x1080-0x10ff]: assigned344vm-test-run-nixbot-gitlab> gitlab # [    0.277230] pci 0000:00:0b.0: BAR 0 [io  0x1100-0x113f]: assigned345vm-test-run-nixbot-gitlab> gitlab # [    0.277285] pci 0000:00:01.0: BAR 0 [io  0x1140-0x115f]: assigned346vm-test-run-nixbot-gitlab> gitlab # [    0.277339] pci 0000:00:02.0: BAR 0 [io  0x1160-0x117f]: assigned347vm-test-run-nixbot-gitlab> gitlab # [    0.277397] pci 0000:00:03.0: BAR 0 [io  0x1180-0x119f]: assigned348vm-test-run-nixbot-gitlab> gitlab # [    0.277453] pci 0000:00:04.0: BAR 0 [io  0x11a0-0x11bf]: assigned349vm-test-run-nixbot-gitlab> gitlab # [    0.277511] pci 0000:00:07.0: BAR 0 [io  0x11c0-0x11df]: assigned350vm-test-run-nixbot-gitlab> gitlab # [    0.277567] pci 0000:00:0c.0: BAR 0 [io  0x11e0-0x11ff]: assigned351vm-test-run-nixbot-gitlab> gitlab # [    0.277650] pci_bus 0000:00: resource 4 [io  0x0000-0xffff]352vm-test-run-nixbot-gitlab> gitlab # [    0.277665] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]353vm-test-run-nixbot-gitlab> gitlab # [    0.277675] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]354vm-test-run-nixbot-gitlab> gitlab # [    0.281763] pci 0000:00:0a.0: enabling device (0000 -> 0002)355vm-test-run-nixbot-gitlab> gitlab # [    0.311351] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)356vm-test-run-nixbot-gitlab> gitlab # [    0.315239] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)357vm-test-run-nixbot-gitlab> gitlab # [    0.319209] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)358vm-test-run-nixbot-gitlab> gitlab # [    0.324012] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)359vm-test-run-nixbot-gitlab> gitlab # [    0.328356] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)360vm-test-run-nixbot-gitlab> gitlab # [    0.332133] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)361vm-test-run-nixbot-gitlab> gitlab # [    0.336649] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)362vm-test-run-nixbot-gitlab> gitlab # [    0.342203] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)363vm-test-run-nixbot-gitlab> gitlab # [    0.346185] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)364vm-test-run-nixbot-gitlab> gitlab # [    0.350715] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)365vm-test-run-nixbot-gitlab> gitlab # [    0.356093] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)366vm-test-run-nixbot-gitlab> gitlab # [    0.366629] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled367vm-test-run-nixbot-gitlab> gitlab # [    0.369998] msm_serial: driver initialized368vm-test-run-nixbot-gitlab> gitlab # [    0.370300] SuperH (H)SCI(F) driver initialized369vm-test-run-nixbot-gitlab> gitlab # [    0.370391] STM32 USART driver initialized370vm-test-run-nixbot-gitlab> gitlab # [    0.404202] loop: module loaded371vm-test-run-nixbot-gitlab> gitlab # [    0.404848] virtio_blk virtio4: 4/0/0 default/read/poll queues372vm-test-run-nixbot-gitlab> gitlab # [    0.409810] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)373vm-test-run-nixbot-gitlab> gitlab # [    0.414770] virtio_blk virtio5: 4/0/0 default/read/poll queues374vm-test-run-nixbot-gitlab> gitlab # [    0.419661] virtio_blk virtio5: [vdb] 12204272 512-byte logical blocks (6.25 GB/5.82 GiB)375vm-test-run-nixbot-gitlab> gitlab # [    0.425453] megasas: 07.734.00.00-rc1376vm-test-run-nixbot-gitlab> gitlab # [    0.427580] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]377vm-test-run-nixbot-gitlab> gitlab # [    0.433375] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000378vm-test-run-nixbot-gitlab> gitlab # [    0.433416] Intel/Sharp Extended Query Table at 0x0031379vm-test-run-nixbot-gitlab> gitlab # [    0.438528] Using buffer write method380vm-test-run-nixbot-gitlab> gitlab # [    0.438663] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]381vm-test-run-nixbot-gitlab> gitlab # [    0.445331] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000382vm-test-run-nixbot-gitlab> gitlab # [    0.445366] Intel/Sharp Extended Query Table at 0x0031383vm-test-run-nixbot-gitlab> gitlab # [    0.449322] Using buffer write method384vm-test-run-nixbot-gitlab> gitlab # [    0.449356] Concatenating MTD devices:385vm-test-run-nixbot-gitlab> gitlab # [    0.449363] (0): "0.flash"386vm-test-run-nixbot-gitlab> gitlab # [    0.449370] (1): "0.flash"387vm-test-run-nixbot-gitlab> gitlab # [    0.449376] into device "0.flash"388vm-test-run-nixbot-gitlab> gitlab # [    0.557858] Freeing initrd memory: 27184K389vm-test-run-nixbot-gitlab> gitlab # [    0.577605] tun: Universal TUN/TAP device driver, 1.6390vm-test-run-nixbot-gitlab> gitlab # [    0.587459] thunder_xcv, ver 1.0391vm-test-run-nixbot-gitlab> gitlab # [    0.587618] thunder_bgx, ver 1.0392vm-test-run-nixbot-gitlab> gitlab # [    0.587700] nicpf, ver 1.0393vm-test-run-nixbot-gitlab> gitlab # [    0.590125] e1000: Intel(R) PRO/1000 Network Driver394vm-test-run-nixbot-gitlab> gitlab # [    0.590142] e1000: Copyright (c) 1999-2006 Intel Corporation.395vm-test-run-nixbot-gitlab> gitlab # [    0.590239] e1000e: Intel(R) PRO/1000 Network Driver396vm-test-run-nixbot-gitlab> gitlab # [    0.590256] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.397vm-test-run-nixbot-gitlab> gitlab # [    0.590369] igb: Intel(R) Gigabit Ethernet Network Driver398vm-test-run-nixbot-gitlab> gitlab # [    0.590380] igb: Copyright (c) 2007-2014 Intel Corporation.399vm-test-run-nixbot-gitlab> gitlab # [    0.590477] igbvf: Intel(R) Gigabit Virtual Function Network Driver400vm-test-run-nixbot-gitlab> gitlab # [    0.590490] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.401vm-test-run-nixbot-gitlab> gitlab # [    0.591091] sky2: driver version 1.30402vm-test-run-nixbot-gitlab> gitlab # [    0.596950] usbcore: registered new interface driver usb-storage403vm-test-run-nixbot-gitlab> gitlab # [    0.597072] ehci-pci 0000:00:0a.0: EHCI Host Controller404vm-test-run-nixbot-gitlab> gitlab # [    0.597141] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1405vm-test-run-nixbot-gitlab> gitlab # [    0.597450] usbcore: registered new interface driver usbserial_generic406vm-test-run-nixbot-gitlab> gitlab # [    0.597504] usbserial: USB Serial support registered for generic407vm-test-run-nixbot-gitlab> gitlab # [    0.598018] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000408vm-test-run-nixbot-gitlab> gitlab # [    0.599904] hv_vmbus: registering driver hyperv_keyboard409vm-test-run-nixbot-gitlab> gitlab # [    0.603140] rtc-pl031 9010000.pl031: registered as rtc0410vm-test-run-nixbot-gitlab> gitlab # [    0.603215] rtc-pl031 9010000.pl031: setting system clock to 2026-08-20T05:46:13 UTC (1787204773)411vm-test-run-nixbot-gitlab> gitlab # [    0.604348] i2c_dev: i2c /dev entries driver412vm-test-run-nixbot-gitlab> gitlab # [    0.606775] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00413vm-test-run-nixbot-gitlab> gitlab # [    0.607737] hub 1-0:1.0: USB hub found414vm-test-run-nixbot-gitlab> gitlab # [    0.607811] hub 1-0:1.0: 6 ports detected415vm-test-run-nixbot-gitlab> gitlab # [    0.614513] sdhci: Secure Digital Host Controller Interface driver416vm-test-run-nixbot-gitlab> gitlab # [    0.614530] sdhci: Copyright(c) Pierre Ossman417vm-test-run-nixbot-gitlab> gitlab # [    0.615448] Synopsys Designware Multimedia Card Interface Driver418vm-test-run-nixbot-gitlab> gitlab # [    0.616763] sdhci-pltfm: SDHCI platform and OF driver helper419vm-test-run-nixbot-gitlab> gitlab # [    0.622194] hid: raw HID events driver (C) Jiri Kosina420vm-test-run-nixbot-gitlab> gitlab # [    0.623206] usbcore: registered new interface driver usbhid421vm-test-run-nixbot-gitlab> gitlab # [    0.623218] usbhid: USB HID core driver422vm-test-run-nixbot-gitlab> gitlab # [    0.632372] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available423vm-test-run-nixbot-gitlab> gitlab # [    0.637286] drop_monitor: Initializing network drop monitor service424vm-test-run-nixbot-gitlab> gitlab # [    0.637631] NET: Registered PF_INET6 protocol family425vm-test-run-nixbot-gitlab> gitlab # [    0.639825] Segment Routing with IPv6426vm-test-run-nixbot-gitlab> gitlab # [    0.639910] In-situ OAM (IOAM) with IPv6427vm-test-run-nixbot-gitlab> gitlab # [    0.639979] NET: Registered PF_PACKET protocol family428vm-test-run-nixbot-gitlab> gitlab # [    0.640290] 9pnet: Installing 9P2000 support429vm-test-run-nixbot-gitlab> gitlab # [    0.644634] Key type dns_resolver registered430vm-test-run-nixbot-gitlab> gitlab # [    0.664137] registered taskstats version 1431vm-test-run-nixbot-gitlab> gitlab # [    0.664598] Loading compiled-in X.509 certificates432vm-test-run-nixbot-gitlab> gitlab # [    0.682962] Demotion targets for Node 0: null433vm-test-run-nixbot-gitlab> gitlab # [    0.683226] Key type .fscrypt registered434vm-test-run-nixbot-gitlab> gitlab # [    0.683233] Key type fscrypt-provisioning registered435vm-test-run-nixbot-gitlab> gitlab # [    0.683424] ima: No TPM chip found, activating TPM-bypass!436vm-test-run-nixbot-gitlab> gitlab # [    0.683446] ima: Allocated hash algorithm: sha1437vm-test-run-nixbot-gitlab> gitlab # [    0.683479] ima: No architecture policies found438vm-test-run-nixbot-gitlab> gitlab # [    0.684768] input: gpio-keys as /devices/platform/gpio-keys/input/input0439vm-test-run-nixbot-gitlab> gitlab # [    0.723841] clk: Disabling unused clocks440vm-test-run-nixbot-gitlab> gitlab # [    0.723897] PM: genpd: Disabling unused power domains441vm-test-run-nixbot-gitlab> gitlab # [    0.731718] Freeing unused kernel memory: 4736K442vm-test-run-nixbot-gitlab> gitlab # [    0.732046] Run /init as init process443vm-test-run-nixbot-gitlab> gitlab # [    0.777933] systemd[1]: Successfully made /usr/ read-only.444vm-test-run-nixbot-gitlab> gitlab # [    0.858691] usb 1-1: new high-speed USB device number 2 using ehci-pci445vm-test-run-nixbot-gitlab> gitlab # [    1.011112] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1446vm-test-run-nixbot-gitlab> gitlab # [    1.103490] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0447vm-test-run-nixbot-gitlab> gitlab # [    1.112939] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)448vm-test-run-nixbot-gitlab> gitlab # [    1.113008] systemd[1]: Detected virtualization qemu.449vm-test-run-nixbot-gitlab> gitlab # [    1.113070] systemd[1]: Detected architecture arm64.450vm-test-run-nixbot-gitlab> gitlab # [    1.113088] systemd[1]: Running in initrd.451vm-test-run-nixbot-gitlab> gitlab # [    1.113943] systemd[1]: Initializing machine ID from random generator.452vm-test-run-nixbot-gitlab> gitlab # [    1.114215] systemd[1]: Hostname set to <gitlab>.453vm-test-run-nixbot-gitlab> gitlab # [    1.222681] usb 1-2: new high-speed USB device number 3 using ehci-pci454vm-test-run-nixbot-gitlab> gitlab # [    1.378225] systemd[1]: bpf-restrict-fs: LSM BPF program attached455vm-test-run-nixbot-gitlab> gitlab # [    1.385270] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2456vm-test-run-nixbot-gitlab> gitlab # [    1.390914] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0457vm-test-run-nixbot-gitlab> gitlab # [    1.480250] systemd[1]: Queued start job for default target Initrd Default Target.458vm-test-run-nixbot-gitlab> gitlab # [    1.508156] systemd[1]: Created slice Slice /system/modprobe.459vm-test-run-nixbot-gitlab> gitlab # [    1.508623] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.460vm-test-run-nixbot-gitlab> gitlab # [    1.508690] systemd[1]: Expecting device /dev/disk/by-label/nix-store...461vm-test-run-nixbot-gitlab> gitlab # [    1.508716] systemd[1]: Expecting device /dev/disk/by-label/nixos...462vm-test-run-nixbot-gitlab> gitlab # [    1.508766] systemd[1]: Reached target Path Units.463vm-test-run-nixbot-gitlab> gitlab # [    1.508802] systemd[1]: Reached target Slice Units.464vm-test-run-nixbot-gitlab> gitlab # [    1.508842] systemd[1]: Reached target Swaps.465vm-test-run-nixbot-gitlab> gitlab # [    1.508910] systemd[1]: Reached target Timer Units.466vm-test-run-nixbot-gitlab> gitlab # [    1.509248] systemd[1]: Listening on D-Bus System Message Bus Socket.467vm-test-run-nixbot-gitlab> gitlab # [    1.509596] systemd[1]: Listening on Journal Socket (/dev/log).468vm-test-run-nixbot-gitlab> gitlab # [    1.509914] systemd[1]: Listening on Journal Sockets.469vm-test-run-nixbot-gitlab> gitlab # [    1.510228] systemd[1]: Listening on udev Control Socket.470vm-test-run-nixbot-gitlab> gitlab # [    1.510483] systemd[1]: Listening on udev Kernel Socket.471vm-test-run-nixbot-gitlab> gitlab # [    1.510528] systemd[1]: Reached target Socket Units.472vm-test-run-nixbot-gitlab> gitlab # [    1.513758] systemd[1]: Starting Create List of Static Device Nodes...473vm-test-run-nixbot-gitlab> gitlab # [    1.517050] systemd[1]: Starting Load Kernel Module 9pnet_virtio...474vm-test-run-nixbot-gitlab> gitlab # [    1.517183] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs475vm-test-run-nixbot-gitlab> gitlab # [    1.520692] systemd[1]: Mounting Kernel Configuration File System...476vm-test-run-nixbot-gitlab> gitlab # [    1.550737] systemd[1]: Starting Journal Service...477vm-test-run-nixbot-gitlab> gitlab # [    1.553458] systemd[1]: Starting Load Kernel Modules...478vm-test-run-nixbot-gitlab> gitlab # [    1.553626] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os479vm-test-run-nixbot-gitlab> gitlab # [    1.555977] systemd[1]: Starting Coldplug All udev Devices...480vm-test-run-nixbot-gitlab> gitlab # [    1.562741] systemd[1]: Finished Create List of Static Device Nodes.481vm-test-run-nixbot-gitlab> gitlab # [    1.564640] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.482vm-test-run-nixbot-gitlab> gitlab # [    1.565307] systemd[1]: Finished Load Kernel Module 9pnet_virtio.483vm-test-run-nixbot-gitlab> gitlab # [    1.572826] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...484vm-test-run-nixbot-gitlab> gitlab # [    1.573777] systemd[1]: Mounted Kernel Configuration File System.485vm-test-run-nixbot-gitlab> gitlab # [    1.599523] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.486vm-test-run-nixbot-gitlab> gitlab # [    1.601750] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0487vm-test-run-nixbot-gitlab> gitlab # [    1.601993] [drm] features: -virgl +edid -resource_blob -host_visible488vm-test-run-nixbot-gitlab> gitlab # [    1.601997] [drm] features: -context_init489vm-test-run-nixbot-gitlab> gitlab # [    1.603170] [drm] number of scanouts: 1490vm-test-run-nixbot-gitlab> gitlab # [    1.603187] [drm] number of cap sets: 0491vm-test-run-nixbot-gitlab> gitlab # [    1.603539] systemd[1]: Starting Create Static Device Nodes in /dev...492vm-test-run-nixbot-gitlab> gitlab # [    1.608458] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic493vm-test-run-nixbot-gitlab> gitlab # [    1.608488] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0494vm-test-run-nixbot-gitlab> gitlab # [    1.617098] systemd-journald[95]: Collecting audit messages is disabled.495vm-test-run-nixbot-gitlab> gitlab # [    1.617289] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.496vm-test-run-nixbot-gitlab> gitlab # [    1.618102] Console: switching to colour frame buffer device 160x50497vm-test-run-nixbot-gitlab> gitlab # [    1.623516] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev498vm-test-run-nixbot-gitlab> gitlab # [    1.625297] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device499vm-test-run-nixbot-gitlab> gitlab # [    1.631554] systemd[1]: Finished Create Static Device Nodes in /dev.500vm-test-run-nixbot-gitlab> gitlab # [    1.631922] systemd[1]: Reached target Preparation for Local File Systems.501vm-test-run-nixbot-gitlab> gitlab # [    1.632481] systemd[1]: Reached target Local File Systems.502vm-test-run-nixbot-gitlab> gitlab # [    1.639650] systemd[1]: Starting Rule-based Manager for Device Events and Files...503vm-test-run-nixbot-gitlab> gitlab # [    1.667176] systemd[1]: Finished Load Kernel Modules.504vm-test-run-nixbot-gitlab> gitlab # [    1.675156] systemd[1]: Starting Apply Kernel Variables...505vm-test-run-nixbot-gitlab> gitlab # [    1.701045] systemd[1]: Finished Apply Kernel Variables.506vm-test-run-nixbot-gitlab> gitlab # [    1.714798] systemd[1]: Started Journal Service.507vm-test-run-nixbot-gitlab> gitlab # [    1.712078] systemd-modules-load[96]: Using 4 probe threads508vm-test-run-nixbot-gitlab> gitlab # [    1.716259] systemd-modules-load[96]: Module 'virtio_balloon' is built in509vm-test-run-nixbot-gitlab> gitlab # [    1.717741] systemd-modules-load[96]: Module 'virtio_console' is built in510vm-test-run-nixbot-gitlab> gitlab # [    1.719159] systemd-modules-load[96]: Module 'virtio_rng' is built in511vm-test-run-nixbot-gitlab> gitlab # [    1.721197] systemd-modules-load[96]: Inserted module 'dm_mod'512vm-test-run-nixbot-gitlab> gitlab # [    1.722498] systemd-modules-load[96]: Inserted module 'virtio_gpu'513vm-test-run-nixbot-gitlab> gitlab # [    1.724112] systemd-udevd[106]: Using default interface naming scheme 'v261'.514vm-test-run-nixbot-gitlab> gitlab # [    1.725600] systemd[1]: Starting Create System Files and Directories...515vm-test-run-nixbot-gitlab> gitlab # [    1.747810] systemd[1]: Finished Create System Files and Directories.516vm-test-run-nixbot-gitlab> gitlab # [    1.750010] systemd[1]: Started Rule-based Manager for Device Events and Files.517vm-test-run-nixbot-gitlab> gitlab # [    1.777787] systemd[1]: Starting Virtual Console Setup...518vm-test-run-nixbot-gitlab> gitlab # [    1.827517] systemd-vconsole-setup[130]: Configuration of first virtual console was skipped, ignoring remaining ones.519vm-test-run-nixbot-gitlab> gitlab # [    1.832695] systemd[1]: Finished Virtual Console Setup.520vm-test-run-nixbot-gitlab> gitlab # [    2.220782] systemd[1]: Finished Coldplug All udev Devices.521vm-test-run-nixbot-gitlab> gitlab # [    2.223453] systemd[1]: Reached target System Initialization.522vm-test-run-nixbot-gitlab> gitlab # [    2.226114] systemd[1]: Reached target Basic System.523vm-test-run-nixbot-gitlab> gitlab # [    2.429691] (udev-worker)[124]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.524vm-test-run-nixbot-gitlab> gitlab # [    2.435540] (udev-worker)[124]: Network interface NamePolicy= disabled on kernel command line.525vm-test-run-nixbot-gitlab> gitlab # [    2.446104] (udev-worker)[119]: Network interface NamePolicy= disabled on kernel command line.526vm-test-run-nixbot-gitlab> gitlab # [    2.462737] systemd[1]: Found device /dev/disk/by-label/nix-store.527vm-test-run-nixbot-gitlab> gitlab # [    2.471368] systemd[1]: Found device /dev/disk/by-label/nixos.528vm-test-run-nixbot-gitlab> gitlab # [    2.478540] systemd[1]: Reached target Initrd Root Device.529vm-test-run-nixbot-gitlab> gitlab # [    2.485416] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...530vm-test-run-nixbot-gitlab> gitlab # [    2.525453] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks531vm-test-run-nixbot-gitlab> gitlab # [    2.533479] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.532vm-test-run-nixbot-gitlab> gitlab # [    2.556057] systemd[1]: Mounting /sysroot...533vm-test-run-nixbot-gitlab> gitlab # [    2.598400] EXT4-fs (vda): mounted filesystem 3f36ff5e-1e3f-40b4-a9e6-a2d57a8b8336 r/w with ordered data mode. Quota mode: none.534vm-test-run-nixbot-gitlab> gitlab # [    2.598956] systemd[1]: Mounted /sysroot.535vm-test-run-nixbot-gitlab> gitlab # [    2.601038] systemd[1]: Reached target Initrd Root File System.536vm-test-run-nixbot-gitlab> gitlab # [    2.606131] systemd[1]: Mounting /sysroot/nix/.ro-store...537vm-test-run-nixbot-gitlab> gitlab # [    2.607409] systemd[1]: Mounting /sysroot/nix/.rw-store...538vm-test-run-nixbot-gitlab> gitlab # [    2.610388] systemd[1]: Mounting /sysroot/run...539vm-test-run-nixbot-gitlab> gitlab # [    2.629076] systemd[1]: Mounting /sysroot/tmp/shared...540vm-test-run-nixbot-gitlab> gitlab # [    2.634805] systemd[1]: Mounting /sysroot/tmp/xchg...541vm-test-run-nixbot-gitlab> gitlab # [    2.640734] systemd[1]: Starting Mountpoints Configured in the Real Root...542vm-test-run-nixbot-gitlab> gitlab # [    2.649202] systemd[1]: Mounted /sysroot/nix/.rw-store.543vm-test-run-nixbot-gitlab> gitlab # [    2.650436] systemd[1]: Mounted /sysroot/run.544vm-test-run-nixbot-gitlab> gitlab # [    2.651312] systemd[1]: Starting rw-sysroot-nix-store.service...545vm-test-run-nixbot-gitlab> gitlab # [    2.669810] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.546vm-test-run-nixbot-gitlab> gitlab # [    2.675527] systemd-sysroot-fstab-check[165]: /sysroot should be mounted in the initrd, will request daemon-reload.547vm-test-run-nixbot-gitlab> gitlab # [    2.677465] systemd[1]: Finished rw-sysroot-nix-store.service.548vm-test-run-nixbot-gitlab> gitlab # [    2.681628] systemd[1]: Reload requested from client PID 165 ('systemd-sysroot') (unit initrd-parse-etc.service)...549vm-test-run-nixbot-gitlab> gitlab # [    2.683247] systemd[1]: Reloading...550vm-test-run-nixbot-gitlab> gitlab # [    2.963231] erofs (device vdb): mounted with root inode @ nid 128.551vm-test-run-nixbot-gitlab> gitlab # [    3.011012] systemd[1]: Reloading finished in 328 ms.552vm-test-run-nixbot-gitlab> gitlab # [    3.059264] (udev-worker)[138]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory553vm-test-run-nixbot-gitlab> gitlab # [    3.063455] (udev-worker)[138]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory554vm-test-run-nixbot-gitlab> gitlab # [    3.078936] systemd-sysroot-fstab-check[165]: Requesting initrd-fs.target/start/replace...555vm-test-run-nixbot-gitlab> gitlab # [    3.082165] systemd[1]: Mounted /sysroot/nix/.ro-store.556vm-test-run-nixbot-gitlab> gitlab # [    3.083076] systemd[1]: Mounted /sysroot/tmp/shared.557vm-test-run-nixbot-gitlab> gitlab # [    3.083823] systemd[1]: Mounted /sysroot/tmp/xchg.558vm-test-run-nixbot-gitlab> gitlab # [    3.087002] systemd-sysroot-fstab-check[165]: Requesting swap.target/start/replace...559vm-test-run-nixbot-gitlab> gitlab # [    3.093515] systemd[1]: initrd-parse-etc.service: Deactivated successfully.560vm-test-run-nixbot-gitlab> gitlab # [    3.094517] systemd[1]: Finished Mountpoints Configured in the Real Root.561vm-test-run-nixbot-gitlab> gitlab # [    3.095471] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.562vm-test-run-nixbot-gitlab> gitlab # [    3.100375] systemd[1]: Starting rw-sysroot-nix-store.service...563vm-test-run-nixbot-gitlab> gitlab # [    3.101395] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.564vm-test-run-nixbot-gitlab> gitlab # [    3.102539] systemd[1]: Stopped Virtual Console Setup.565vm-test-run-nixbot-gitlab> gitlab # [    3.103366] systemd[1]: Stopping Virtual Console Setup...566vm-test-run-nixbot-gitlab> gitlab # [    3.104266] systemd[1]: Starting Virtual Console Setup...567vm-test-run-nixbot-gitlab> gitlab # [    3.123601] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.568vm-test-run-nixbot-gitlab> gitlab # [    3.125515] systemd[1]: Finished rw-sysroot-nix-store.service.569vm-test-run-nixbot-gitlab> gitlab # [    3.137715] systemd-vconsole-setup[198]: Configuration of first virtual console was skipped, ignoring remaining ones.570vm-test-run-nixbot-gitlab> gitlab # [    3.140373] systemd[1]: Finished Virtual Console Setup.571vm-test-run-nixbot-gitlab> gitlab # [    3.562842] systemd[1]: Mounting /sysroot/nix/store...572vm-test-run-nixbot-gitlab> gitlab # [    3.641876] systemd[1]: Mounted /sysroot/nix/store.573vm-test-run-nixbot-gitlab> gitlab # [    3.644314] systemd[1]: Reached target Initrd File Systems.574vm-test-run-nixbot-gitlab> gitlab # [    3.646760] systemd[1]: Starting Find NixOS closure...575vm-test-run-nixbot-gitlab> gitlab # [    3.649110] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...576vm-test-run-nixbot-gitlab> gitlab # [    3.692071] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.577vm-test-run-nixbot-gitlab> gitlab # [    3.695677] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.578vm-test-run-nixbot-gitlab> gitlab # [    3.711812] systemd[1]: Finished Find NixOS closure.579vm-test-run-nixbot-gitlab> gitlab # [    3.714311] systemd[1]: Reached target Initrd Default Target.580vm-test-run-nixbot-gitlab> gitlab # [    3.716854] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...581vm-test-run-nixbot-gitlab> gitlab # [    3.775919] systemd[1]: Stopped target Initrd Default Target.582vm-test-run-nixbot-gitlab> gitlab # [    3.778489] systemd[1]: Stopped target Basic System.583vm-test-run-nixbot-gitlab> gitlab # [    3.780744] systemd[1]: Stopped target Initrd Root Device.584vm-test-run-nixbot-gitlab> gitlab # [    3.783093] systemd[1]: Stopped target Path Units.585vm-test-run-nixbot-gitlab> gitlab # [    3.785261] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.586vm-test-run-nixbot-gitlab> gitlab # [    3.788477] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.587vm-test-run-nixbot-gitlab> gitlab # [    3.791694] systemd[1]: Stopped target Slice Units.588vm-test-run-nixbot-gitlab> gitlab # [    3.794022] systemd[1]: Stopped target Socket Units.589vm-test-run-nixbot-gitlab> gitlab # [    3.796244] systemd[1]: Stopped target System Initialization.590vm-test-run-nixbot-gitlab> gitlab # [    3.800466] systemd[1]: Stopped target Swaps.591vm-test-run-nixbot-gitlab> gitlab # [    3.802529] systemd[1]: Stopped target Timer Units.592vm-test-run-nixbot-gitlab> gitlab # [    3.804781] systemd[1]: dbus.socket: Deactivated successfully.593vm-test-run-nixbot-gitlab> gitlab # [    3.809020] systemd[1]: Closed D-Bus System Message Bus Socket.594vm-test-run-nixbot-gitlab> gitlab # [    3.811681] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.595vm-test-run-nixbot-gitlab> gitlab # [    3.819245] systemd[1]: Stopped Find NixOS closure.596vm-test-run-nixbot-gitlab> gitlab # [    3.822093] systemd[1]: Starting Load Kernel Module 9pnet_virtio...597vm-test-run-nixbot-gitlab> gitlab # [    3.824458] systemd[1]: Starting rw-sysroot-nix-store.service...598vm-test-run-nixbot-gitlab> gitlab # [    3.826637] systemd[1]: systemd-sysctl.service: Deactivated successfully.599vm-test-run-nixbot-gitlab> gitlab # [    3.829266] systemd[1]: Stopped Apply Kernel Variables.600vm-test-run-nixbot-gitlab> gitlab # [    3.831385] systemd[1]: systemd-modules-load.service: Deactivated successfully.601vm-test-run-nixbot-gitlab> gitlab # [    3.834135] systemd[1]: Stopped Load Kernel Modules.602vm-test-run-nixbot-gitlab> gitlab # [    3.836146] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.603vm-test-run-nixbot-gitlab> gitlab # [    3.839098] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.604vm-test-run-nixbot-gitlab> gitlab # [    3.842000] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.605vm-test-run-nixbot-gitlab> gitlab # [    3.844762] systemd[1]: Stopped Create System Files and Directories.606vm-test-run-nixbot-gitlab> gitlab # [    3.846999] systemd[1]: Stopped target Local File Systems.607vm-test-run-nixbot-gitlab> gitlab # [    3.849005] systemd[1]: Stopped target Preparation for Local File Systems.608vm-test-run-nixbot-gitlab> gitlab # [    3.851191] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.609vm-test-run-nixbot-gitlab> gitlab # [    3.853496] systemd[1]: Stopped Coldplug All udev Devices.610vm-test-run-nixbot-gitlab> gitlab # [    3.855175] systemd[1]: Stopping Rule-based Manager for Device Events and Files...611vm-test-run-nixbot-gitlab> gitlab # [    3.857360] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.612vm-test-run-nixbot-gitlab> gitlab # [    3.859395] systemd[1]: Stopped Virtual Console Setup.613vm-test-run-nixbot-gitlab> gitlab # [    3.860867] systemd[1]: initrd-cleanup.service: Deactivated successfully.614vm-test-run-nixbot-gitlab> gitlab # [    3.862637] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.615vm-test-run-nixbot-gitlab> gitlab # [    3.864293] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.616vm-test-run-nixbot-gitlab> gitlab # [    3.866065] systemd[1]: Finished rw-sysroot-nix-store.service.617vm-test-run-nixbot-gitlab> gitlab # [    3.867482] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.618vm-test-run-nixbot-gitlab> gitlab # [    3.870449] systemd[1]: Finished Load Kernel Module 9pnet_virtio.619vm-test-run-nixbot-gitlab> gitlab # [    3.871898] systemd[1]: systemd-udevd.service: Deactivated successfully.620vm-test-run-nixbot-gitlab> gitlab # [    3.873595] systemd[1]: Stopped Rule-based Manager for Device Events and Files.621vm-test-run-nixbot-gitlab> gitlab # [    3.875317] systemd[1]: systemd-udevd.service: Consumed 2.390s CPU time over 2.209s wall clock time, 31.7M memory peak.622vm-test-run-nixbot-gitlab> gitlab # [    3.877901] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.623vm-test-run-nixbot-gitlab> gitlab # [    3.879802] systemd[1]: Closed udev Control Socket.624vm-test-run-nixbot-gitlab> gitlab # [    3.881161] systemd[1]: Starting Cleanup udev Database...625vm-test-run-nixbot-gitlab> gitlab # [    3.882520] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.626vm-test-run-nixbot-gitlab> gitlab # [    3.884396] systemd[1]: Stopped Create Static Device Nodes in /dev.627vm-test-run-nixbot-gitlab> gitlab # [    3.885873] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.628vm-test-run-nixbot-gitlab> gitlab # [    3.887988] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.629vm-test-run-nixbot-gitlab> gitlab # [    3.889715] systemd[1]: kmod-static-nodes.service: Deactivated successfully.630vm-test-run-nixbot-gitlab> gitlab # [    3.891386] systemd[1]: Stopped Create List of Static Device Nodes.631vm-test-run-nixbot-gitlab> gitlab # [    3.960274] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.632vm-test-run-nixbot-gitlab> gitlab # [    3.963529] systemd[1]: Finished Cleanup udev Database.633vm-test-run-nixbot-gitlab> gitlab # [    3.965924] systemd[1]: Reached target Switch Root.634vm-test-run-nixbot-gitlab> gitlab # [    3.968103] systemd[1]: Starting NixOS Activation...635vm-test-run-nixbot-gitlab> gitlab # [    4.173564] initrd-nixos-activation-start[225]: booting system configuration /nix/store/nsc0n24i32a3x9a6f4mbrx2gf4jn0alr-nixos-system-gitlab-test636vm-test-run-nixbot-gitlab> gitlab # [    4.234755] initrd-nixos-activation-start[225]: running activation script...637vm-test-run-nixbot-gitlab> gitlab # [    4.535171] initrd-nixos-activation-start[248]: setting up /etc...638vm-test-run-nixbot-gitlab> gitlab # [    4.708432] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.639vm-test-run-nixbot-gitlab> gitlab # [    4.711783] systemd[1]: Finished NixOS Activation.640vm-test-run-nixbot-gitlab> gitlab # [    4.714101] systemd[1]: Starting Switch Root...641vm-test-run-nixbot-gitlab> gitlab # [    4.787793] systemd[1]: Switching root.642vm-test-run-nixbot-gitlab> gitlab # [    4.883218] systemd-journald[95]: Received SIGTERM from PID 1 (systemd).643vm-test-run-nixbot-gitlab> gitlab # [    5.501664] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)644vm-test-run-nixbot-gitlab> gitlab # [    5.502429] systemd[1]: Detected virtualization qemu.645vm-test-run-nixbot-gitlab> gitlab # [    5.503450] systemd[1]: Detected architecture arm64.646vm-test-run-nixbot-gitlab> gitlab # [    5.503654] systemd[1]: Detected first boot.647vm-test-run-nixbot-gitlab> gitlab # [    5.505094] systemd[1]: Initializing machine ID from random generator.648vm-test-run-nixbot-gitlab> gitlab # [    5.777544] systemd[1]: bpf-restrict-fs: LSM BPF program attached649vm-test-run-nixbot-gitlab> gitlab # [    5.902777] systemd[1]: Applying preset policy.650vm-test-run-nixbot-gitlab> gitlab # [    6.111705] systemd[1]: Populated /etc with preset unit settings.651vm-test-run-nixbot-gitlab> gitlab # [    6.333488] systemd[1]: initrd-switch-root.service: Deactivated successfully.652vm-test-run-nixbot-gitlab> gitlab # [    6.333885] systemd[1]: Stopped initrd-switch-root.service.653vm-test-run-nixbot-gitlab> gitlab # [    6.337623] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.654vm-test-run-nixbot-gitlab> gitlab # [    6.344826] systemd[1]: Created slice Slice /system/getty.655vm-test-run-nixbot-gitlab> gitlab # [    6.348723] systemd[1]: Created slice GitLab DevOps Platform Slice.656vm-test-run-nixbot-gitlab> gitlab # [    6.352432] systemd[1]: Created slice User and Session Slice.657vm-test-run-nixbot-gitlab> gitlab # [    6.353231] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.658vm-test-run-nixbot-gitlab> gitlab # [    6.354081] systemd[1]: Started Forward Password Requests to Wall Directory Watch.659vm-test-run-nixbot-gitlab> gitlab # [    6.355080] systemd[1]: Expecting device /dev/hvc0...660vm-test-run-nixbot-gitlab> gitlab # [    6.355635] systemd[1]: Expecting device /dev/ttyAMA0...661vm-test-run-nixbot-gitlab> gitlab # [    6.356486] systemd[1]: Reached target Local Encrypted Volumes.662vm-test-run-nixbot-gitlab> gitlab # [    6.357357] systemd[1]: Stopped target initrd-fs.target.663vm-test-run-nixbot-gitlab> gitlab # [    6.358179] systemd[1]: Stopped target initrd-root-fs.target.664vm-test-run-nixbot-gitlab> gitlab # [    6.359019] systemd[1]: Stopped target initrd-switch-root.target.665vm-test-run-nixbot-gitlab> gitlab # [    6.359878] systemd[1]: Reached target Virtual Machines and Containers.666vm-test-run-nixbot-gitlab> gitlab # [    6.360707] systemd[1]: Reached target Path Units.667vm-test-run-nixbot-gitlab> gitlab # [    6.361536] systemd[1]: Reached target Remote File Systems.668vm-test-run-nixbot-gitlab> gitlab # [    6.362503] systemd[1]: Reached target Slice Units.669vm-test-run-nixbot-gitlab> gitlab # [    6.363335] systemd[1]: Reached target Swaps.670vm-test-run-nixbot-gitlab> gitlab # [    6.365640] systemd[1]: Listening on Query the User Interactively for a Password.671vm-test-run-nixbot-gitlab> gitlab # [    6.367757] systemd[1]: Listening on Process Core Dump Socket.672vm-test-run-nixbot-gitlab> gitlab # [    6.369335] systemd[1]: Listening on Credential Encryption/Decryption.673vm-test-run-nixbot-gitlab> gitlab # [    6.371162] systemd[1]: Listening on Factory Reset Management.674vm-test-run-nixbot-gitlab> gitlab # [    6.371846] systemd[1]: Listening on Hostname Service Socket.675vm-test-run-nixbot-gitlab> gitlab # [    6.378389] systemd[1]: Starting Journal Log Access Socket...676vm-test-run-nixbot-gitlab> gitlab # [    6.379712] systemd[1]: Listening on Journal Audit Socket.677vm-test-run-nixbot-gitlab> gitlab # [    6.381938] systemd[1]: Listening on Console Output Muting Service Socket.678vm-test-run-nixbot-gitlab> gitlab # [    6.382850] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.679vm-test-run-nixbot-gitlab> gitlab # [    6.383475] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os680vm-test-run-nixbot-gitlab> gitlab # [    6.384205] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki681vm-test-run-nixbot-gitlab> gitlab # [    6.387619] systemd[1]: Listening on Disk Repartitioning Service Socket.682vm-test-run-nixbot-gitlab> gitlab # [    6.388375] systemd[1]: Listening on udev Control Socket.683vm-test-run-nixbot-gitlab> gitlab # [    6.389115] systemd[1]: Listening on udev Varlink Socket.684vm-test-run-nixbot-gitlab> gitlab # [    6.452101] systemd[1]: Mounting Huge Pages File System...685vm-test-run-nixbot-gitlab> gitlab # [    6.458149] systemd[1]: Mounting POSIX Message Queue File System...686vm-test-run-nixbot-gitlab> gitlab # [    6.464643] systemd[1]: Mounting Kernel Debug File System...687vm-test-run-nixbot-gitlab> gitlab # [    6.470803] systemd[1]: Mounting Kernel Trace File System...688vm-test-run-nixbot-gitlab> gitlab # [    6.480169] systemd[1]: Starting Create List of Static Device Nodes...689vm-test-run-nixbot-gitlab> gitlab # [    6.495043] systemd[1]: Starting Load Kernel Module 9pnet_virtio...690vm-test-run-nixbot-gitlab> gitlab # [    6.496176] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs691vm-test-run-nixbot-gitlab> gitlab # [    6.512419] systemd[1]: Mounting Kernel Configuration File System...692vm-test-run-nixbot-gitlab> gitlab # [    6.513479] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm693vm-test-run-nixbot-gitlab> gitlab # [    6.514369] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore694vm-test-run-nixbot-gitlab> gitlab # [    6.525856] systemd[1]: Starting Load Kernel Module fuse...695vm-test-run-nixbot-gitlab> gitlab # [    6.528284] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67696vm-test-run-nixbot-gitlab> gitlab # [    6.536331] systemd[1]: Starting Journal Service...697vm-test-run-nixbot-gitlab> gitlab # [    6.539870] systemd[1]: Starting Load Kernel Modules...698vm-test-run-nixbot-gitlab> gitlab # [    6.547371] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...699vm-test-run-nixbot-gitlab> gitlab # [    6.554798] systemd[1]: Starting Remount Root and Kernel File Systems...700vm-test-run-nixbot-gitlab> gitlab # [    6.555423] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os701vm-test-run-nixbot-gitlab> gitlab # [    6.566003] fuse: init (API version 7.45)702vm-test-run-nixbot-gitlab> gitlab # [    6.573140] systemd[1]: Starting Coldplug All udev Devices...703vm-test-run-nixbot-gitlab> gitlab # [    6.586534] systemd[1]: Listening on Journal Log Access Socket.704vm-test-run-nixbot-gitlab> gitlab # [    6.587515] systemd[1]: Mounted Huge Pages File System.705vm-test-run-nixbot-gitlab> gitlab # [    6.588530] systemd[1]: Mounted POSIX Message Queue File System.706vm-test-run-nixbot-gitlab> gitlab # [    6.589462] systemd[1]: Mounted Kernel Debug File System.707vm-test-run-nixbot-gitlab> gitlab # [    6.590335] systemd[1]: Mounted Kernel Trace File System.708vm-test-run-nixbot-gitlab> gitlab # [    6.591695] systemd[1]: Finished Create List of Static Device Nodes.709vm-test-run-nixbot-gitlab> gitlab # [    6.592957] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.710vm-test-run-nixbot-gitlab> gitlab # [    6.594029] systemd[1]: Finished Load Kernel Module 9pnet_virtio.711vm-test-run-nixbot-gitlab> gitlab # [    6.595012] systemd[1]: Mounted Kernel Configuration File System.712vm-test-run-nixbot-gitlab> gitlab # [    6.596021] systemd[1]: modprobe@fuse.service: Deactivated successfully.713vm-test-run-nixbot-gitlab> gitlab # [    6.597053] systemd[1]: Finished Load Kernel Module fuse.714vm-test-run-nixbot-gitlab> gitlab # [    6.608843] EXT4-fs (vda): re-mounted 3f36ff5e-1e3f-40b4-a9e6-a2d57a8b8336.715vm-test-run-nixbot-gitlab> gitlab # [    6.609422] systemd[1]: Mounting FUSE Control File System...716vm-test-run-nixbot-gitlab> gitlab # [    6.623252] systemd-journald[319]: Collecting audit messages is enabled.717vm-test-run-nixbot-gitlab> gitlab # [    6.631733] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...718vm-test-run-nixbot-gitlab> gitlab # [    6.639215] systemd[1]: Finished Load Kernel Modules.719vm-test-run-nixbot-gitlab> gitlab # [    6.640984] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.720vm-test-run-nixbot-gitlab> gitlab # [    6.641938] systemd[1]: Finished Remount Root and Kernel File Systems.721vm-test-run-nixbot-gitlab> gitlab # [    6.642752] systemd[1]: Mounted FUSE Control File System.722vm-test-run-nixbot-gitlab> gitlab # [    6.643843] systemd[1]: Listening on Disk Image Download Service Socket.723vm-test-run-nixbot-gitlab> gitlab # [    6.650771] systemd[1]: Starting Firewall...724vm-test-run-nixbot-gitlab> gitlab # [    6.641465] systemd[1]: Queued start job for default target Multi-User System.725vm-test-run-nixbot-gitlab> gitlab # [    6.651304] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore726vm-test-run-nixbot-gitlab> gitlab # [    6.656113] systemd[1]: Unnecessary job was removed for /dev/vdb.727vm-test-run-nixbot-gitlab> gitlab # [    6.657385] systemd[1]: systemd-journald.service: Deactivated successfully.728vm-test-run-nixbot-gitlab> gitlab # [    6.658761] systemd-modules-load[320]: Using 3 probe threads729vm-test-run-nixbot-gitlab> gitlab # [    6.659851] systemd-modules-load[320]: Module 'atkbd' is built in[    6.662943] systemd[1]: Starting Load/Save OS Random Seed...730vm-test-run-nixbot-gitlab> gitlab # 731vm-test-run-nixbot-gitlab> gitlab # [    6.663610] systemd-modules-load[320]: Module 'loop' is built in732vm-test-run-nixbot-gitlab> gitlab # [    6.664889] systemd-modules-load[320]: Inserted module 'tls'733vm-test-run-nixbot-gitlab> gitlab # [    6.666257] systemd-oomd[321]: No swap; memory pressure usage will be degraded734vm-test-run-nixbot-gitlab> gitlab # [    6.671842] systemd[1]: Starting Apply Kernel Variables...735vm-test-run-nixbot-gitlab> gitlab # [    6.672933] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os736vm-test-run-nixbot-gitlab> gitlab # [    6.675003] systemd[1]: Started Journal Service.737vm-test-run-nixbot-gitlab> gitlab # [    6.678461] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.738vm-test-run-nixbot-gitlab> gitlab # [    6.695100] systemd[1]: Finished Load/Save OS Random Seed.739vm-test-run-nixbot-gitlab> gitlab # [    6.697518] systemd[1]: Finished Apply Kernel Variables.740vm-test-run-nixbot-gitlab> gitlab # [    6.702458] systemd[1]: Reached target First Boot Complete.741vm-test-run-nixbot-gitlab> gitlab # [    6.705053] systemd[1]: Starting Flush Journal to Persistent Storage...742vm-test-run-nixbot-gitlab> gitlab # [    6.709749] systemd[1]: Starting Create Static Device Nodes in /dev...743vm-test-run-nixbot-gitlab> gitlab # [    6.722366] systemd-journald[319]: Received client request to flush runtime journal.744vm-test-run-nixbot-gitlab> gitlab # [    6.741105] systemd[1]: Finished Flush Journal to Persistent Storage.745vm-test-run-nixbot-gitlab> gitlab # [    6.743144] systemd[1]: Finished Create Static Device Nodes in /dev.746vm-test-run-nixbot-gitlab> gitlab # [    6.747027] systemd[1]: Reached target Preparation for Local File Systems.747vm-test-run-nixbot-gitlab> gitlab # [    6.748461] systemd[1]: Starting Rule-based Manager for Device Events and Files...748vm-test-run-nixbot-gitlab> gitlab # [    6.828490] systemd-udevd[368]: Using default interface naming scheme 'v261'.749vm-test-run-nixbot-gitlab> gitlab # [    6.874127] systemd[1]: Started Rule-based Manager for Device Events and Files.750vm-test-run-nixbot-gitlab> gitlab # [    7.119813] systemd[1]: Finished Firewall.751vm-test-run-nixbot-gitlab> gitlab # [    7.284486] systemd[1]: Finished Coldplug All udev Devices.752vm-test-run-nixbot-gitlab> gitlab # [    7.339457] systemd[1]: Mounting /run/wrappers...753vm-test-run-nixbot-gitlab> gitlab # [    7.350045] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs754vm-test-run-nixbot-gitlab> gitlab # [    7.392557] systemd[1]: Mounted /run/wrappers.755vm-test-run-nixbot-gitlab> gitlab # [    7.396852] systemd[1]: Reached target Local File Systems.756vm-test-run-nixbot-gitlab> gitlab # [    7.403002] systemd[1]: Listening on Boot Loader Control Service Socket.757vm-test-run-nixbot-gitlab> gitlab # [    7.418767] systemd[1]: Starting register-nix-paths.service...758vm-test-run-nixbot-gitlab> gitlab # [    7.424206] systemd[1]: Starting Create SUID/SGID Wrappers...759vm-test-run-nixbot-gitlab> gitlab # [    7.426798] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.760vm-test-run-nixbot-gitlab> gitlab # [    7.448643] (udev-worker)[423]: Network interface NamePolicy= disabled on kernel command line.761vm-test-run-nixbot-gitlab> gitlab # [    7.460427] systemd[1]: Starting Save Transient machine-id to Disk...762vm-test-run-nixbot-gitlab> gitlab # [    7.463835] systemd[1]: Starting Create System Files and Directories...763vm-test-run-nixbot-gitlab> gitlab # [    7.470135] (udev-worker)[420]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.764vm-test-run-nixbot-gitlab> gitlab # [    7.473526] (udev-worker)[420]: Network interface NamePolicy= disabled on kernel command line.765vm-test-run-nixbot-gitlab> gitlab # [    7.475619] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.766vm-test-run-nixbot-gitlab> gitlab # [    7.496131] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.767vm-test-run-nixbot-gitlab> gitlab # [    7.498016] systemd[1]: Finished Save Transient machine-id to Disk.768vm-test-run-nixbot-gitlab> gitlab # [    7.504222] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.769vm-test-run-nixbot-gitlab> gitlab # [    7.505739] systemd[1]: Condition check resulted in Virtio network device being skipped.770vm-test-run-nixbot-gitlab> gitlab # [    7.507883] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore771vm-test-run-nixbot-gitlab> gitlab # [    7.510281] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.772vm-test-run-nixbot-gitlab> gitlab # [    7.515181] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67773vm-test-run-nixbot-gitlab> gitlab # [    7.518501] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore774vm-test-run-nixbot-gitlab> gitlab # [    7.522217] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os775vm-test-run-nixbot-gitlab> gitlab # [    7.524085] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os776vm-test-run-nixbot-gitlab> gitlab # [    7.526483] systemd[1]: Finished Create System Files and Directories.777vm-test-run-nixbot-gitlab> gitlab # [    7.533095] systemd[1]: Starting Rebuild Journal Catalog...778vm-test-run-nixbot-gitlab> gitlab # [    7.538042] systemd[1]: Starting Record System Boot/Shutdown in UTMP...779vm-test-run-nixbot-gitlab> gitlab # [    7.570293] systemd[1]: Finished Record System Boot/Shutdown in UTMP.780vm-test-run-nixbot-gitlab> gitlab # [    7.599636] systemd[1]: Finished Rebuild Journal Catalog.781vm-test-run-nixbot-gitlab> gitlab # [    7.601554] systemd[1]: Starting Update is Completed...782vm-test-run-nixbot-gitlab> gitlab # [    7.617499] mousedev: PS/2 mouse device common for all mice783vm-test-run-nixbot-gitlab> gitlab # [    7.639897] systemd[1]: Finished Update is Completed.784vm-test-run-nixbot-gitlab> gitlab # [    7.681840] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.785vm-test-run-nixbot-gitlab> gitlab # [    7.683314] systemd[1]: Finished Create SUID/SGID Wrappers.786vm-test-run-nixbot-gitlab> gitlab # [    7.684284] systemd[1]: suid-sgid-wrappers.service: Consumed 158ms CPU time over 259ms wall clock time, 6.3M memory peak, 1.9M read from disk.787vm-test-run-nixbot-gitlab> gitlab # [    7.941041] systemd[1]: Finished register-nix-paths.service.788vm-test-run-nixbot-gitlab> gitlab # [    7.942504] systemd[1]: Reached target System Initialization.789vm-test-run-nixbot-gitlab> gitlab # [    7.943821] systemd[1]: Started Discard unused filesystem blocks once a week.790vm-test-run-nixbot-gitlab> gitlab # [    7.945226] systemd[1]: Started logrotate.timer.791vm-test-run-nixbot-gitlab> gitlab # [    7.945978] systemd[1]: Started Daily Cleanup of Temporary Directories.792vm-test-run-nixbot-gitlab> gitlab # [    7.946953] systemd[1]: Reached target Timer Units.793vm-test-run-nixbot-gitlab> gitlab # [    7.947703] systemd[1]: Listening on D-Bus System Message Bus Socket.794vm-test-run-nixbot-gitlab> gitlab # [    7.948766] systemd[1]: Listening on Nix Daemon Socket.795vm-test-run-nixbot-gitlab> gitlab # [    7.956133] systemd[1]: Starting nixbot CI service socket...796vm-test-run-nixbot-gitlab> gitlab # [    7.957128] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.797vm-test-run-nixbot-gitlab> gitlab # [    7.958383] systemd[1]: Listening on nixbot CI service socket.798vm-test-run-nixbot-gitlab> gitlab # [    7.959230] systemd[1]: Reached target Socket Units.799vm-test-run-nixbot-gitlab> gitlab # [    7.961871] systemd[1]: Starting D-Bus System Message Bus...800vm-test-run-nixbot-gitlab> gitlab # [    7.999834] dbus-broker-launch[564]: Looking up NSS user entry for 'systemd-timesync'...801vm-test-run-nixbot-gitlab> gitlab # [    8.002330] dbus-broker-launch[564]: NSS returned no entry for 'systemd-timesync'802vm-test-run-nixbot-gitlab> gitlab # [    8.003484] dbus-broker-launch[564]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"803vm-test-run-nixbot-gitlab> gitlab # [    8.007244] systemd[1]: Started D-Bus System Message Bus.804vm-test-run-nixbot-gitlab> gitlab # [    8.020298] dbus-broker-launch[564]: Ready805vm-test-run-nixbot-gitlab> gitlab # [    8.021724] systemd[1]: Reached target Basic System.806vm-test-run-nixbot-gitlab> gitlab # [    8.026253] systemd[1]: Started backdoor.service.807vm-test-run-nixbot-gitlab> gitlab # [    8.032447] systemd[1]: Starting gitlab-config.service...808vm-test-run-nixbot-gitlab> gitlab # [    8.045096] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3809vm-test-run-nixbot-gitlab> gitlab # [    8.057095] systemd[1]: Starting Import lastlog data into lastlog2 database...810vm-test-run-nixbot-gitlab> gitlab # [    8.062460] systemd[1]: Starting Logrotate configuration check...811vm-test-run-nixbot-gitlab> gitlab # connecting to host...812vm-test-run-nixbot-gitlab> gitlab # [    8.080187] systemd[1]: Starting Name Service Cache Daemon (nsncd)...813vm-test-run-nixbot-gitlab> gitlab # [    8.081413] systemd[1]: Starting Post-Boot Actions...814vm-test-run-nixbot-gitlab> gitlab # [    8.083892] logrotate[571]: warning: logrotate in debug mode does nothing except printing debug messages!  Consider using verbose mode (-v) instead if this is not what you want.815vm-test-run-nixbot-gitlab> gitlab # [    8.098090] logrotate[571]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf816vm-test-run-nixbot-gitlab> gitlab # [    8.099695] logrotate[571]: note: 'monthly' overrides previously specified 'weekly'817vm-test-run-nixbot-gitlab> gitlab # [    8.100852] logrotate[571]: Reading state from file: /var/lib/logrotate.status818vm-test-run-nixbot-gitlab> gitlab # [    8.101831] logrotate[571]: state file /var/lib/logrotate.status does not exist819vm-test-run-nixbot-gitlab> gitlab # [    8.102832] logrotate[571]: Allocating hash table for state file, size 64 entries820vm-test-run-nixbot-gitlab> gitlab: Guest shell says: b'Spawning backdoor root shell...\n'821vm-test-run-nixbot-gitlab> gitlab # [    8.108487] logrotate[571]: Handling 4 logs822vm-test-run-nixbot-gitlab> gitlab # [    8.109105] logrotate[571]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed823vm-test-run-nixbot-gitlab> gitlab # [    8.110958] logrotate[571]: considering log /var/log/btmp824vm-test-run-nixbot-gitlab> gitlab: connected to guest root shell825vm-test-run-nixbot-gitlab> gitlab # [    8.112154] logrotate[571]: Creating new state826vm-test-run-nixbot-gitlab> gitlab: (connecting took 8.57 seconds)827vm-test-run-nixbot-gitlab> gitlab # [    8.112750] logrotate[571]:   Now: 2026-08-20 05:46828vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for the VM to finish booting, in 8.57 seconds)829vm-test-run-nixbot-gitlab> gitlab # [    8.113373] logrotate[571]:   Last rotated at 2026-08-20 05:00830vm-test-run-nixbot-gitlab> gitlab # [    8.120623] logrotate[571]:   log does not need rotating (log has already been rotated)831vm-test-run-nixbot-gitlab> gitlab # [    8.121606] logrotate[571]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed832vm-test-run-nixbot-gitlab> gitlab # [    8.123776] logrotate[571]: considering log /var/log/wtmp833vm-test-run-nixbot-gitlab> gitlab # [    8.125776] logrotate[571]: Creating new state834vm-test-run-nixbot-gitlab> gitlab # [    8.126460] logrotate[571]:   Now: 2026-08-20 05:46835vm-test-run-nixbot-gitlab> gitlab # [    8.127112] logrotate[571]:   Last rotated at 2026-08-20 05:00836vm-test-run-nixbot-gitlab> gitlab # [    8.127934] logrotate[571]:   log does not need rotating (log has already been rotated)837vm-test-run-nixbot-gitlab> gitlab # [    8.132211] logrotate[571]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed838vm-test-run-nixbot-gitlab> gitlab # [    8.134240] logrotate[571]: switching euid from 0 to 165 and egid from 0 to 165 (pid 571)839vm-test-run-nixbot-gitlab> gitlab # [    8.135324] logrotate[571]: considering log /var/gitlab/state/log/*.log840vm-test-run-nixbot-gitlab> gitlab # [    8.136279] logrotate[571]:   log /var/gitlab/state/log/*.log does not exist -- skipping841vm-test-run-nixbot-gitlab> gitlab # [    8.137457] logrotate[571]: Creating new state842vm-test-run-nixbot-gitlab> gitlab # [    8.138090] logrotate[571]: switching euid from 165 to 0 and egid from 165 to 0 (pid 571)843vm-test-run-nixbot-gitlab> gitlab # [    8.139308] logrotate[571]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed844vm-test-run-nixbot-gitlab> gitlab # [    8.143438] logrotate[571]: switching euid from 0 to 60 and egid from 0 to 60 (pid 571)845vm-test-run-nixbot-gitlab> gitlab # [    8.144861] logrotate[571]: considering log /var/log/nginx/*.log846vm-test-run-nixbot-gitlab> gitlab # [    8.145768] logrotate[571]:   log /var/log/nginx/*.log does not exist -- skipping847vm-test-run-nixbot-gitlab> gitlab # [    8.146809] logrotate[571]: Creating new state848vm-test-run-nixbot-gitlab> gitlab # [    8.147496] logrotate[571]: not running postrotate script, since no logs were rotated849vm-test-run-nixbot-gitlab> gitlab # [    8.150575] logrotate[571]: switching euid from 60 to 0 and egid from 60 to 0 (pid 571)850vm-test-run-nixbot-gitlab> gitlab # [    8.151808] systemd[1]: Started Reset console on configuration changes.851vm-test-run-nixbot-gitlab> gitlab # [    8.154917] nsncd[574]: Aug 20 05:46:21.040 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"852vm-test-run-nixbot-gitlab> gitlab # [    8.173967] systemd[1]: Starting resolvconf update...853vm-test-run-nixbot-gitlab> gitlab # [    8.175128] systemd[1]: Finished Logrotate configuration check.854vm-test-run-nixbot-gitlab> gitlab # [    8.176305] systemd[1]: Finished Post-Boot Actions.855vm-test-run-nixbot-gitlab> gitlab # [    8.177141] systemd[1]: Finished Import lastlog data into lastlog2 database.856vm-test-run-nixbot-gitlab> gitlab # [    8.178460] systemd[1]: Started Name Service Cache Daemon (nsncd).857vm-test-run-nixbot-gitlab> gitlab # [    8.179529] systemd[1]: Reached target Host and Network Name Lookups.858vm-test-run-nixbot-gitlab> gitlab # [    8.182032] systemd[1]: Reached target User and Group Name Lookups.859vm-test-run-nixbot-gitlab> gitlab # [    8.183368] systemd[1]: Starting User Login Management...860vm-test-run-nixbot-gitlab> gitlab # [    8.244140] systemd[1]: Starting Virtual Console Setup...861vm-test-run-nixbot-gitlab> gitlab # [    8.253620] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.862vm-test-run-nixbot-gitlab> gitlab # [    8.255284] systemd[1]: Stopped Virtual Console Setup.863vm-test-run-nixbot-gitlab> gitlab # [    8.259038] systemd-logind[619]: New seat seat0.864vm-test-run-nixbot-gitlab> gitlab # [    8.262890] systemd[1]: Starting Virtual Console Setup...865vm-test-run-nixbot-gitlab> gitlab # [    8.271315] systemd-logind[619]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)866vm-test-run-nixbot-gitlab> gitlab # [    8.272760] systemd-logind[619]: Watching system buttons on /dev/input/event0 (gpio-keys)867vm-test-run-nixbot-gitlab> gitlab # [    8.273932] systemd[1]: Started User Login Management.868vm-test-run-nixbot-gitlab> gitlab # [    8.285115] systemd[1]: Stopped target Host and Network Name Lookups.869vm-test-run-nixbot-gitlab> gitlab # [    8.286348] systemd[1]: Stopping Host and Network Name Lookups...870vm-test-run-nixbot-gitlab> gitlab # [    8.287359] systemd[1]: Stopped target User and Group Name Lookups.871vm-test-run-nixbot-gitlab> gitlab # [    8.290521] systemd[1]: Stopping User and Group Name Lookups...872vm-test-run-nixbot-gitlab> gitlab # [    8.293094] systemd[1]: Starting linger-users.service...873vm-test-run-nixbot-gitlab> gitlab # [    8.297648] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...874vm-test-run-nixbot-gitlab> gitlab # [    8.298845] systemd[1]: nscd.service: Deactivated successfully.875vm-test-run-nixbot-gitlab> gitlab # [    8.310434] systemd[1]: Stopped Name Service Cache Daemon (nsncd).876vm-test-run-nixbot-gitlab> gitlab # [    8.311838] systemd[1]: nscd.service: Consumed 24ms CPU time over 222ms wall clock time, 7.6M memory peak, 5.8M read from disk.877vm-test-run-nixbot-gitlab> gitlab # [    8.316307] systemd-logind[619]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)878vm-test-run-nixbot-gitlab> gitlab # [    8.317635] systemd[1]: Starting Name Service Cache Daemon (nsncd)...879vm-test-run-nixbot-gitlab> gitlab # [    8.321027] systemd[1]: Finished resolvconf update.880vm-test-run-nixbot-gitlab> gitlab # [    8.323645] systemd[1]: Reached target Preparation for Network.881vm-test-run-nixbot-gitlab> gitlab # [    8.325433] systemd[1]: Starting DHCP Client...882vm-test-run-nixbot-gitlab> gitlab # [    8.334435] systemd[1]: Starting Address configuration of eth1...883vm-test-run-nixbot-gitlab> gitlab # [    8.339013] systemd[1]: Starting Extra networking commands....884vm-test-run-nixbot-gitlab> gitlab # [    8.345222] systemd-vconsole-setup[660]: Configuration of first virtual console was skipped, ignoring remaining ones.885vm-test-run-nixbot-gitlab> gitlab # [    8.347381] nsncd[680]: Aug 20 05:46:21.244 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"886vm-test-run-nixbot-gitlab> gitlab # [    8.355592] systemd[1]: Started Name Service Cache Daemon (nsncd).887vm-test-run-nixbot-gitlab> gitlab # [    8.356975] systemd[1]: Finished Virtual Console Setup.888vm-test-run-nixbot-gitlab> gitlab # [    8.357759] systemd[1]: linger-users.service: Deactivated successfully.889vm-test-run-nixbot-gitlab> gitlab # [    8.358723] systemd[1]: Finished linger-users.service.890vm-test-run-nixbot-gitlab> gitlab # [    8.362928] systemd[1]: Reached target Host and Network Name Lookups.891vm-test-run-nixbot-gitlab> gitlab # [    8.364129] systemd[1]: Reached target User and Group Name Lookups.892vm-test-run-nixbot-gitlab> gitlab # [    8.375796] network-addresses-eth1-start[686]: adding address 192.168.1.1/24... done893vm-test-run-nixbot-gitlab> gitlab # [    8.381622] network-addresses-eth1-start[686]: adding address 2001:db8:1::1/64... done894vm-test-run-nixbot-gitlab> gitlab # [    8.389573] systemd[1]: Finished Address configuration of eth1.895vm-test-run-nixbot-gitlab> gitlab # [    8.426628] dhcpcd[700]: dhcpcd-10.3.2 starting896vm-test-run-nixbot-gitlab> gitlab # [    8.428560] systemd[1]: Finished Extra networking commands..897vm-test-run-nixbot-gitlab> gitlab # [    8.429781] dhcpcd[760]: dev: loaded udev898vm-test-run-nixbot-gitlab> gitlab # [    8.432150] systemd[1]: Reached target Network.899vm-test-run-nixbot-gitlab> gitlab # [    8.438535] systemd[1]: Starting gitlab-workhorse.service...900vm-test-run-nixbot-gitlab> gitlab # [    8.439520] systemd[1]: Starting Nginx Web Server...901vm-test-run-nixbot-gitlab> gitlab # [    8.442668] systemd[1]: Starting PostgreSQL Server...902vm-test-run-nixbot-gitlab> gitlab # [    8.446752] 8021q: 802.1Q VLAN Support v1.8903vm-test-run-nixbot-gitlab> gitlab # [    8.447195] 8021q: adding VLAN 0 to HW filter on device eth1904vm-test-run-nixbot-gitlab> gitlab # [    8.452745] systemd[1]: Starting Redis Server - redis-gitlab...905vm-test-run-nixbot-gitlab> gitlab # [    8.457413] systemd[1]: Starting Permit User Sessions...906vm-test-run-nixbot-gitlab> gitlab # [    8.465591] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.907vm-test-run-nixbot-gitlab> gitlab # [    8.487956] systemd[1]: Finished Permit User Sessions.908vm-test-run-nixbot-gitlab> gitlab # [    8.489055] systemd[1]: Started Getty on tty1.909vm-test-run-nixbot-gitlab> gitlab # [    8.492834] systemd[1]: Reached target Login Prompts.910vm-test-run-nixbot-gitlab> gitlab # [    8.504774] cfg80211: Loading compiled-in X.509 certificates for regulatory database911vm-test-run-nixbot-gitlab> gitlab # [    8.514849] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'912vm-test-run-nixbot-gitlab> gitlab # [    8.517041] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'913vm-test-run-nixbot-gitlab> gitlab # [    8.519616] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2914vm-test-run-nixbot-gitlab> gitlab # [    8.519941] cfg80211: failed to load regulatory.db915vm-test-run-nixbot-gitlab> gitlab # [    8.558280] 8021q: adding VLAN 0 to HW filter on device eth0916vm-test-run-nixbot-gitlab> gitlab # [    8.557991] dhcpcd[760]: eth0: waiting for carrier917vm-test-run-nixbot-gitlab> gitlab # [    8.559444] dhcpcd[760]: eth0: carrier acquired918vm-test-run-nixbot-gitlab> gitlab # [    8.569345] dhcpcd[760]: DUID 00:01:00:01:32:19:51:2d:52:54:00:12:34:56919vm-test-run-nixbot-gitlab> gitlab # [    8.571167] dhcpcd[760]: eth0: IAID 00:12:34:56920vm-test-run-nixbot-gitlab> gitlab # [    8.573559] dhcpcd[760]: eth0: adding address fe80::5054:ff:fe12:3456921vm-test-run-nixbot-gitlab> gitlab # [    8.608225] nginx-pre-start[795]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok922vm-test-run-nixbot-gitlab> gitlab # [    8.611296] nginx-pre-start[795]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful923vm-test-run-nixbot-gitlab> gitlab # [    8.617502] redis-server[788]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.924vm-test-run-nixbot-gitlab> gitlab # [    8.619752] redis-server[788]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo925vm-test-run-nixbot-gitlab> gitlab # [    8.621222] systemd[1]: Started Redis Server - redis-gitlab.926vm-test-run-nixbot-gitlab> gitlab # [    8.622138] redis-server[788]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=788, just started927vm-test-run-nixbot-gitlab> gitlab # [    8.623642] redis-server[788]: Configuration loaded928vm-test-run-nixbot-gitlab> gitlab # [    8.624654] systemd[1]: Started Nginx Web Server.929vm-test-run-nixbot-gitlab> gitlab # [    8.625439] redis[788]: monotonic clock: ARM CNTVCT @ 1000 ticks/us930vm-test-run-nixbot-gitlab> gitlab # [    8.626499] redis[788]: Running mode=standalone, port=0.931vm-test-run-nixbot-gitlab> gitlab # [    8.627461] redis[788]: Server initialized932vm-test-run-nixbot-gitlab> gitlab # [    8.628372] redis[788]: Ready to accept connections unix933vm-test-run-nixbot-gitlab> gitlab # [    8.629360] redis[788]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.934vm-test-run-nixbot-gitlab> gitlab # [    8.663030] postgresql-pre-start[800]: The files belonging to this database system will be owned by user "postgres".935vm-test-run-nixbot-gitlab> gitlab # [    8.665027] postgresql-pre-start[800]: This user must also own the server process.936vm-test-run-nixbot-gitlab> gitlab # [    8.669894] postgresql-pre-start[800]: The database cluster will be initialized with locale "en_US.UTF-8".937vm-test-run-nixbot-gitlab> gitlab # [    8.671395] postgresql-pre-start[800]: The default database encoding has accordingly been set to "UTF8".938vm-test-run-nixbot-gitlab> gitlab # [    8.672902] postgresql-pre-start[800]: The default text search configuration will be set to "english".939vm-test-run-nixbot-gitlab> gitlab # [    8.674222] postgresql-pre-start[800]: Data page checksums are enabled.940vm-test-run-nixbot-gitlab> gitlab # [    8.675198] postgresql-pre-start[800]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok941vm-test-run-nixbot-gitlab> gitlab # [    8.677117] postgresql-pre-start[800]: creating subdirectories ... ok942vm-test-run-nixbot-gitlab> gitlab # [    8.678107] postgresql-pre-start[800]: selecting dynamic shared memory implementation ... posix943vm-test-run-nixbot-gitlab> gitlab # [    8.708415] dhcpcd[760]: eth0: soliciting a DHCP lease944vm-test-run-nixbot-gitlab> gitlab # [    8.716329] postgresql-pre-start[800]: selecting default "max_connections" ... 100945vm-test-run-nixbot-gitlab> gitlab # [    8.720577] dhcpcd[760]: eth0: offered 10.0.2.15 from 10.0.2.2946vm-test-run-nixbot-gitlab> gitlab # [    8.744212] dhcpcd[760]: eth0: probing address 10.0.2.15/24947vm-test-run-nixbot-gitlab> gitlab # [    8.768137] postgresql-pre-start[800]: selecting default "shared_buffers" ... 128MB948vm-test-run-nixbot-gitlab> gitlab # [    9.075260] systemd[1]: Started gitlab-workhorse.service.949vm-test-run-nixbot-gitlab> gitlab # [    9.221559] postgresql-pre-start[800]: selecting default time zone ... UTC950vm-test-run-nixbot-gitlab> gitlab # [    9.224427] postgresql-pre-start[800]: creating configuration files ... ok951vm-test-run-nixbot-gitlab> gitlab # [    9.420591] gitlab-workhorse[822]: time="2026-08-20T05:46:22Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4952vm-test-run-nixbot-gitlab> gitlab # [    9.423459] gitlab-workhorse[822]: time="2026-08-20T05:46:22Z" level=info msg="Using redis/go-redis"953vm-test-run-nixbot-gitlab> gitlab # [    9.425700] gitlab-workhorse[822]: time="2026-08-20T05:46:22Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix954vm-test-run-nixbot-gitlab> gitlab # [    9.438444] postgresql-pre-start[800]: running bootstrap script ... ok955vm-test-run-nixbot-gitlab> gitlab # [   10.105688] postgresql-pre-start[800]: performing post-bootstrap initialization ... ok956vm-test-run-nixbot-gitlab> gitlab # [   10.477580] dhcpcd[760]: eth0: soliciting an IPv6 router957vm-test-run-nixbot-gitlab> gitlab # [   10.480576] dhcpcd[760]: eth0: Router Advertisement from fe80::2958vm-test-run-nixbot-gitlab> gitlab # [   10.483296] postgresql-pre-start[800]: syncing data to disk ... ok959vm-test-run-nixbot-gitlab> gitlab # [   10.485964] postgresql-pre-start[800]: initdb: warning: enabling "trust" authentication for local connections960vm-test-run-nixbot-gitlab> gitlab # [   10.490176] postgresql-pre-start[800]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.961vm-test-run-nixbot-gitlab> gitlab # [   10.497322] postgresql-pre-start[800]: Success. You can now start the database server using:962vm-test-run-nixbot-gitlab> gitlab # [   10.500966] postgresql-pre-start[800]:     pg_ctl -D /var/lib/postgresql/18 -l logfile start963vm-test-run-nixbot-gitlab> gitlab # [   10.504667] dhcpcd[760]: eth0: adding address fec0::5054:ff:fe12:3456/64964vm-test-run-nixbot-gitlab> gitlab # [   10.507770] dhcpcd[760]: eth0: adding route to fec0::/64965vm-test-run-nixbot-gitlab> gitlab # [   10.510323] dhcpcd[760]: eth0: adding default route via fe80::2966vm-test-run-nixbot-gitlab> gitlab # [   10.612314] postgres[856]: [856] LOG:  starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit967vm-test-run-nixbot-gitlab> gitlab # [   10.614991] postgres[856]: [856] LOG:  listening on IPv6 address "::1", port 5432968vm-test-run-nixbot-gitlab> gitlab # [   10.616719] postgres[856]: [856] LOG:  listening on IPv4 address "127.0.0.1", port 5432969vm-test-run-nixbot-gitlab> gitlab # [   10.618501] postgres[856]: [856] LOG:  listening on Unix socket "/run/postgresql/.s.PGSQL.5432"970vm-test-run-nixbot-gitlab> gitlab # [   10.632673] postgres[865]: [865] LOG:  database system was shut down at 2026-08-20 05:46:22 GMT971vm-test-run-nixbot-gitlab> gitlab # [   10.644172] postgres[856]: [856] LOG:  database system is ready to accept connections972vm-test-run-nixbot-gitlab> gitlab # [   10.649856] systemd[1]: Started PostgreSQL Server.973vm-test-run-nixbot-gitlab> gitlab # [   10.655901] systemd[1]: Starting PostgreSQL Setup Scripts...974vm-test-run-nixbot-gitlab> gitlab # [   11.104155] postgresql-setup-start[876]: CREATE DATABASE975vm-test-run-nixbot-gitlab> gitlab # [   11.149775] postgresql-setup-start[886]: CREATE ROLE976vm-test-run-nixbot-gitlab> gitlab # [   11.174585] postgresql-setup-start[888]: ALTER DATABASE977vm-test-run-nixbot-gitlab> gitlab # [   11.221840] postgresql-setup-start[893]: CREATE ROLE978vm-test-run-nixbot-gitlab> gitlab # [   11.226730] systemd[1]: Finished PostgreSQL Setup Scripts.979vm-test-run-nixbot-gitlab> gitlab # [   11.229324] systemd[1]: Reached target PostgreSQL.980vm-test-run-nixbot-gitlab> gitlab # [   11.234118] systemd[1]: Starting gitlab-postgresql.service...981vm-test-run-nixbot-gitlab> gitlab # [   11.289256] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[881]: mkdir -p /var/gitlab/state/home/.ssh: OK982vm-test-run-nixbot-gitlab> gitlab # [   11.293474] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[881]: chmod 700 /var/gitlab/state/home/.ssh: OK983vm-test-run-nixbot-gitlab> gitlab # [   11.397554] systemd[1]: Finished gitlab-config.service.984vm-test-run-nixbot-gitlab> gitlab # [   11.404661] systemd[1]: Started gitaly.service.985vm-test-run-nixbot-gitlab> gitlab # [   11.411060] systemd[1]: Starting gitlab-db-config.service...986vm-test-run-nixbot-gitlab> gitlab # [   11.430344] gitlab-postgresql-start[905]: CREATE DATABASE987vm-test-run-nixbot-gitlab> gitlab # [   11.519748] gitlab-postgresql-start[925]: CREATE EXTENSION988vm-test-run-nixbot-gitlab> gitlab # [   11.638176] gitlab-postgresql-start[932]: CREATE EXTENSION989vm-test-run-nixbot-gitlab> gitlab # [   11.647042] systemd[1]: Finished gitlab-postgresql.service.990vm-test-run-nixbot-gitlab> gitlab # [   12.236826] gitaly[915]: time="2026-08-20T05:46:25.131Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=915991vm-test-run-nixbot-gitlab> gitlab # [   12.252766] gitaly[915]: time="2026-08-20T05:46:25.132Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=915992vm-test-run-nixbot-gitlab> gitlab # [   12.254380] gitaly[915]: time="2026-08-20T05:46:25.132Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=915993vm-test-run-nixbot-gitlab> gitlab # [   12.256705] gitaly[915]: time="2026-08-20T05:46:25.132Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=915994vm-test-run-nixbot-gitlab> gitlab # [   12.258937] gitaly[915]: time="2026-08-20T05:46:25.132Z" level=info msg="Starting Gitaly" pid=915 version=995vm-test-run-nixbot-gitlab> gitlab # [   12.434378] gitaly[915]: time="2026-08-20T05:46:25.333Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=201 pid=915996vm-test-run-nixbot-gitlab> gitlab # [   12.438225] gitaly[915]: time="2026-08-20T05:46:25.333Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=915997vm-test-run-nixbot-gitlab> gitlab # [   12.441624] gitaly[915]: time="2026-08-20T05:46:25.334Z" level=info msg="finished initializing command factory" duration_ms=0 pid=915998vm-test-run-nixbot-gitlab> gitlab # [   12.445405] gitaly[915]: time="2026-08-20T05:46:25.334Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-915/git-exec-3213783215.d/git pid=915999vm-test-run-nixbot-gitlab> gitlab # [   12.448446] gitaly[915]: time="2026-08-20T05:46:25.339Z" level=info msg="finished detecting git version" duration_ms=5 pid=9151000vm-test-run-nixbot-gitlab> gitlab # [   12.450823] gitaly[915]: time="2026-08-20T05:46:25.339Z" level=info msg="using Git version" pid=915 version=2.53.g1001vm-test-run-nixbot-gitlab> gitlab # [   12.453600] gitaly[915]: time="2026-08-20T05:46:25.339Z" level=info msg="clearing disk cache object folder" pid=915 storage=default1002vm-test-run-nixbot-gitlab> gitlab # [   12.455937] gitaly[915]: time="2026-08-20T05:46:25.340Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache36577017 pid=915 storage=default1003vm-test-run-nixbot-gitlab> gitlab # [   12.461023] gitaly[915]: time="2026-08-20T05:46:25.340Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache36577017 pid=915 storage=default1004vm-test-run-nixbot-gitlab> gitlab # [   12.465694] gitaly[915]: time="2026-08-20T05:46:25.340Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9151005vm-test-run-nixbot-gitlab> gitlab # [   12.471542] gitaly[915]: time="2026-08-20T05:46:25.340Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9151006vm-test-run-nixbot-gitlab> gitlab # [   12.476904] gitaly[915]: time="2026-08-20T05:46:25.340Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache36577017 clear_duration_ms=0 pid=915 storage=default1007vm-test-run-nixbot-gitlab> gitlab # [   12.481983] gitaly[915]: time="2026-08-20T05:46:25.366Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9151008vm-test-run-nixbot-gitlab> gitlab # [   12.486630] gitaly[915]: time="2026-08-20T05:46:25.366Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=915 schema=unix1009vm-test-run-nixbot-gitlab> gitlab # [   12.490950] gitaly[915]: time="2026-08-20T05:46:25.366Z" level=info msg="listening at address" address=/run/gitaly/gitaly-915/sock.d/intern pid=915 schema=unix1010vm-test-run-nixbot-gitlab> gitlab # [   12.494958] gitaly[915]: time="2026-08-20T05:46:25.367Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9151011vm-test-run-nixbot-gitlab> gitlab # [   12.498502] gitaly[915]: time="2026-08-20T05:46:25.367Z" level=info msg="Started Gitaly" duration_ms=235 pid=9151012vm-test-run-nixbot-gitlab> gitlab # [   12.501366] gitaly[915]: time="2026-08-20T05:46:25.367Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9151013vm-test-run-nixbot-gitlab> gitlab # [   12.504787] gitaly[915]: time="2026-08-20T05:46:25.371Z" level=info msg="counting repositories" pid=9151014vm-test-run-nixbot-gitlab> gitlab # [   12.507606] gitaly[915]: time="2026-08-20T05:46:25.371Z" level=info msg="starting to count repositories" pid=915 storage_path=/var/gitlab/state/repositories1015vm-test-run-nixbot-gitlab> gitlab # [   12.510858] gitaly[915]: time="2026-08-20T05:46:25.371Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=915 storage_path=/var/gitlab/state/repositories1016vm-test-run-nixbot-gitlab> gitlab # [   12.515077] gitaly[915]: time="2026-08-20T05:46:25.371Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9151017vm-test-run-nixbot-gitlab> gitlab # [   12.518346] gitaly[915]: time="2026-08-20T05:46:25.371Z" level=info msg="finished tempdir cleaner walk" pid=915 storage=default time_ms=01018vm-test-run-nixbot-gitlab> gitlab # [   12.521717] gitaly[915]: time="2026-08-20T05:46:25.373Z" level=info msg="maintenance: daily scheduled" pid=915 scheduled="2026-08-20 12:00:00 +0000 UTC"1019vm-test-run-nixbot-gitlab> gitlab # [   12.792844] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[924]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1020vm-test-run-nixbot-gitlab> gitlab # [   12.801082] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[924]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1021vm-test-run-nixbot-gitlab> gitlab # [   12.817715] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[924]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1022vm-test-run-nixbot-gitlab> gitlab # [   13.094680] dhcpcd[760]: eth0: leased 10.0.2.15 for 86400 seconds1023vm-test-run-nixbot-gitlab> gitlab # [   13.097766] dhcpcd[760]: eth0: adding route to 10.0.2.0/241024vm-test-run-nixbot-gitlab> gitlab # [   13.100187] dhcpcd[760]: eth0: adding default route via 10.0.2.21025vm-test-run-nixbot-gitlab> gitlab # [   13.319172] systemd[1]: Started DHCP Client.1026vm-test-run-nixbot-gitlab> gitlab # [   13.321607] systemd[1]: Reached target Network is Online.1027vm-test-run-nixbot-gitlab> gitlab # [   15.976849] gitaly[915]: time="2026-08-20T05:46:28.874Z" level=info msg="License database preloaded" duration_ms=3742 pid=9151028vm-test-run-nixbot-gitlab> gitlab # [   61.364800] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[924]: W, [2026-08-20T05:47:14.262499 #924]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1029vm-test-run-nixbot-gitlab> gitlab # [   65.387441] postgres[1477]: [1477] ERROR:  relation "feature_gates" does not exist at character 5231030vm-test-run-nixbot-gitlab> gitlab # [   65.392177] postgres[1477]: [1477] STATEMENT:  SELECT a.attname, format_type(a.atttypid, a.atttypmod),1031vm-test-run-nixbot-gitlab> gitlab # [   65.396285] postgres[1477]: 	       pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1032vm-test-run-nixbot-gitlab> gitlab # [   65.400515] postgres[1477]: 	       c.collname, col_description(a.attrelid, a.attnum) AS comment,1033vm-test-run-nixbot-gitlab> gitlab # [   65.404219] postgres[1477]: 	       attidentity AS identity,1034vm-test-run-nixbot-gitlab> gitlab # [   65.406694] postgres[1477]: 	       attgenerated as attgenerated1035vm-test-run-nixbot-gitlab> gitlab # [   65.409444] postgres[1477]: 	  FROM pg_attribute a1036vm-test-run-nixbot-gitlab> gitlab # [   65.411583] postgres[1477]: 	  LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1037vm-test-run-nixbot-gitlab> gitlab # [   65.415462] postgres[1477]: 	  LEFT JOIN pg_type t ON a.atttypid = t.oid1038vm-test-run-nixbot-gitlab> gitlab # [   65.418379] postgres[1477]: 	  LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1039vm-test-run-nixbot-gitlab> gitlab # [   65.422974] postgres[1477]: 	 WHERE a.attrelid = '"feature_gates"'::regclass1040vm-test-run-nixbot-gitlab> gitlab # [   65.426028] postgres[1477]: 	   AND a.attnum > 0 AND NOT a.attisdropped1041vm-test-run-nixbot-gitlab> gitlab # [   65.428984] postgres[1477]: 	 ORDER BY a.attnum1042vm-test-run-nixbot-gitlab> gitlab # [   65.431030] postgres[1477]:1043vm-test-run-nixbot-gitlab> gitlab # [   69.501737] gitlab-workhorse[822]: time="2026-08-20T05:47:22Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1044vm-test-run-nixbot-gitlab> gitlab # [   70.838419] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1529]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE:  extension "btree_gist" already exists, skipping1045vm-test-run-nixbot-gitlab> gitlab # [   70.838860] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1529]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE:  extension "pg_trgm" already exists, skipping1046vm-test-run-nixbot-gitlab> gitlab # [   79.510392] gitlab-workhorse[822]: time="2026-08-20T05:47:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1047vm-test-run-nixbot-gitlab> gitlab # [   89.511583] gitlab-workhorse[822]: time="2026-08-20T05:47:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1048vm-test-run-nixbot-gitlab> gitlab # [   96.570795] postgres[1631]: [1631] ERROR:  relation "table_without_models" does not exist1049vm-test-run-nixbot-gitlab> gitlab # [   96.574702] postgres[1631]: [1631] STATEMENT:  SELECT pg_get_serial_sequence('table_without_models', 'id')1050vm-test-run-nixbot-gitlab> gitlab # [   99.522011] gitlab-workhorse[822]: time="2026-08-20T05:47:52Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1051vm-test-run-nixbot-gitlab> gitlab # [  109.530406] gitlab-workhorse[822]: time="2026-08-20T05:48:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1052vm-test-run-nixbot-gitlab> gitlab # [  119.538366] gitlab-workhorse[822]: time="2026-08-20T05:48:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1053vm-test-run-nixbot-gitlab> gitlab # [  128.034321] systemd[1]: Finished gitlab-db-config.service.1054vm-test-run-nixbot-gitlab> gitlab # [  128.044194] systemd[1]: Started gitlab-sidekiq.service.1055vm-test-run-nixbot-gitlab> gitlab # [  128.046692] systemd[1]: Starting gitlab.service...1056vm-test-run-nixbot-gitlab> gitlab # [  128.671618] bundle[2015]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1057vm-test-run-nixbot-gitlab> gitlab # [  128.679486] bundle[2015]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1058vm-test-run-nixbot-gitlab> gitlab # [  128.685879] bundle[2015]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1059vm-test-run-nixbot-gitlab> gitlab # [  129.545355] gitlab-workhorse[822]: time="2026-08-20T05:48:22Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1060vm-test-run-nixbot-gitlab> gitlab # [  133.740322] bundle[2015]: {"timestamp":"2026-08-20T05:48:26.606Z","pid":2015,"message":"* Enabling systemd notification integration"}1061vm-test-run-nixbot-gitlab> gitlab # [  133.740791] bundle[2015]: {"timestamp":"2026-08-20T05:48:26.638Z","pid":2015,"message":"Puma starting in cluster mode..."}1062vm-test-run-nixbot-gitlab> gitlab # [  133.740930] bundle[2015]: {"timestamp":"2026-08-20T05:48:26.638Z","pid":2015,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1063vm-test-run-nixbot-gitlab> gitlab # [  133.741033] bundle[2015]: {"timestamp":"2026-08-20T05:48:26.638Z","pid":2015,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1064vm-test-run-nixbot-gitlab> gitlab # [  133.741218] bundle[2015]: {"timestamp":"2026-08-20T05:48:26.638Z","pid":2015,"message":"*  Min threads: 0"}1065vm-test-run-nixbot-gitlab> gitlab # [  133.741356] bundle[2015]: {"timestamp":"2026-08-20T05:48:26.638Z","pid":2015,"message":"*  Max threads: 4"}1066vm-test-run-nixbot-gitlab> gitlab # [  133.741471] bundle[2015]: {"timestamp":"2026-08-20T05:48:26.638Z","pid":2015,"message":"*  Environment: production"}1067vm-test-run-nixbot-gitlab> gitlab # [  133.741585] bundle[2015]: {"timestamp":"2026-08-20T05:48:26.638Z","pid":2015,"message":"*   Master PID: 2015"}1068vm-test-run-nixbot-gitlab> gitlab # [  133.741683] bundle[2015]: {"timestamp":"2026-08-20T05:48:26.638Z","pid":2015,"message":"*      Workers: 2"}1069vm-test-run-nixbot-gitlab> gitlab # [  133.741792] bundle[2015]: {"timestamp":"2026-08-20T05:48:26.638Z","pid":2015,"message":"*     Restarts: (✔) hot (✖) phased (✖) refork"}1070vm-test-run-nixbot-gitlab> gitlab # [  133.741907] bundle[2015]: {"timestamp":"2026-08-20T05:48:26.638Z","pid":2015,"message":"* Preloading application"}1071vm-test-run-nixbot-gitlab> gitlab # [  133.785193] sidekiq-cluster[2014]: {"severity":"INFO","time":"2026-08-20T05:48:26.653Z","message":"Starting cluster with 1 processes"}1072vm-test-run-nixbot-gitlab> gitlab # [  139.545668] gitlab-workhorse[822]: time="2026-08-20T05:48:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1073vm-test-run-nixbot-gitlab> gitlab # [  149.554283] gitlab-workhorse[822]: time="2026-08-20T05:48:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1074vm-test-run-nixbot-gitlab> gitlab # [  159.562415] gitlab-workhorse[822]: time="2026-08-20T05:48:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1075vm-test-run-nixbot-gitlab> gitlab # [  169.564394] gitlab-workhorse[822]: time="2026-08-20T05:49:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1076vm-test-run-nixbot-gitlab> gitlab # [  179.565435] gitlab-workhorse[822]: time="2026-08-20T05:49:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1077vm-test-run-nixbot-gitlab> gitlab # [  180.435821] bundle[2015]: W, [2026-08-20T05:49:13.333803 #2015]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1078vm-test-run-nixbot-gitlab> gitlab # [  186.637925] sidekiq-cluster[2065]: 2026-08-20T05:49:19.535Z pid=2065 tid=xq1 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2065, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>434036736}1079vm-test-run-nixbot-gitlab> gitlab # [  187.063288] sidekiq-cluster[2065]: W, [2026-08-20T05:49:19.962358 #2065]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1080vm-test-run-nixbot-gitlab> gitlab # [  187.143823] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:20.042Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1081vm-test-run-nixbot-gitlab> gitlab # [  189.576360] gitlab-workhorse[822]: time="2026-08-20T05:49:22Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1082vm-test-run-nixbot-gitlab> gitlab # [  191.398375] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.296Z","message":"GitLab reliable fetch activated!"}1083vm-test-run-nixbot-gitlab> gitlab # [  191.398947] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.296Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1084vm-test-run-nixbot-gitlab> gitlab # [  191.440205] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.339Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1085vm-test-run-nixbot-gitlab> gitlab # [  191.447107] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.342Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1086vm-test-run-nixbot-gitlab> gitlab # [  191.454305] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.345Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1087vm-test-run-nixbot-gitlab> gitlab # [  191.461014] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.349Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1088vm-test-run-nixbot-gitlab> gitlab # [  191.468402] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.352Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1089vm-test-run-nixbot-gitlab> gitlab # [  191.475090] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.355Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1090vm-test-run-nixbot-gitlab> gitlab # [  191.483361] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.358Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1091vm-test-run-nixbot-gitlab> gitlab # [  191.489040] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.361Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1092vm-test-run-nixbot-gitlab> gitlab # [  191.493808] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.379Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1093vm-test-run-nixbot-gitlab> gitlab # [  191.498287] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.386Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1094vm-test-run-nixbot-gitlab> gitlab # [  191.503049] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.391Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1095vm-test-run-nixbot-gitlab> gitlab # [  191.507325] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.398Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1096vm-test-run-nixbot-gitlab> gitlab # [  191.511061] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.404Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1097vm-test-run-nixbot-gitlab> gitlab # [  191.514856] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.409Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1098vm-test-run-nixbot-gitlab> gitlab # [  191.518428] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.415Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1099vm-test-run-nixbot-gitlab> gitlab # [  191.523040] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.420Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1100vm-test-run-nixbot-gitlab> gitlab # [  191.527888] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.427Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1101vm-test-run-nixbot-gitlab> gitlab # [  191.535590] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.434Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1102vm-test-run-nixbot-gitlab> gitlab # [  191.541278] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.440Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1103vm-test-run-nixbot-gitlab> gitlab # [  191.546475] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.445Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1104vm-test-run-nixbot-gitlab> gitlab # [  191.552339] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.450Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1105vm-test-run-nixbot-gitlab> gitlab # [  191.558038] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.455Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1106vm-test-run-nixbot-gitlab> gitlab # [  191.562706] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.459Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1107vm-test-run-nixbot-gitlab> gitlab # [  191.567226] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.464Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1108vm-test-run-nixbot-gitlab> gitlab # [  191.574738] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.473Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1109vm-test-run-nixbot-gitlab> gitlab # [  191.583369] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.482Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1110vm-test-run-nixbot-gitlab> gitlab # [  191.588796] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.487Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1111vm-test-run-nixbot-gitlab> gitlab # [  191.593701] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.492Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1112vm-test-run-nixbot-gitlab> gitlab # [  191.598935] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.497Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1113vm-test-run-nixbot-gitlab> gitlab # [  191.604128] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.502Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1114vm-test-run-nixbot-gitlab> gitlab # [  191.608367] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.506Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1115vm-test-run-nixbot-gitlab> gitlab # [  191.612783] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.510Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1116vm-test-run-nixbot-gitlab> gitlab # [  191.616474] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.513Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1117vm-test-run-nixbot-gitlab> gitlab # [  191.620219] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.517Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1118vm-test-run-nixbot-gitlab> gitlab # [  191.623659] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.520Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1119vm-test-run-nixbot-gitlab> gitlab # [  191.627196] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.523Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1120vm-test-run-nixbot-gitlab> gitlab # [  191.630561] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.526Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1121vm-test-run-nixbot-gitlab> gitlab # [  191.633630] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.530Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1122vm-test-run-nixbot-gitlab> gitlab # [  191.636537] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.532Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1123vm-test-run-nixbot-gitlab> gitlab # [  191.639264] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.535Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1124vm-test-run-nixbot-gitlab> gitlab # [  191.642289] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.537Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1125vm-test-run-nixbot-gitlab> gitlab # [  191.645128] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.540Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1126vm-test-run-nixbot-gitlab> gitlab # [  191.647789] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.542Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1127vm-test-run-nixbot-gitlab> gitlab # [  191.650550] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.545Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1128vm-test-run-nixbot-gitlab> gitlab # [  191.653250] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.548Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1129vm-test-run-nixbot-gitlab> gitlab # [  191.655875] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.551Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1130vm-test-run-nixbot-gitlab> gitlab # [  191.658508] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.553Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1131vm-test-run-nixbot-gitlab> gitlab # [  191.660978] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.556Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1132vm-test-run-nixbot-gitlab> gitlab # [  191.663229] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.559Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1133vm-test-run-nixbot-gitlab> gitlab # [  191.665655] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.561Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1134vm-test-run-nixbot-gitlab> gitlab # [  191.667911] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.564Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1135vm-test-run-nixbot-gitlab> gitlab # [  191.670336] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.567Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1136vm-test-run-nixbot-gitlab> gitlab # [  191.681515] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.580Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1137vm-test-run-nixbot-gitlab> gitlab # [  191.684626] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.583Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1138vm-test-run-nixbot-gitlab> gitlab # [  191.687440] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.586Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1139vm-test-run-nixbot-gitlab> gitlab # [  191.690453] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.589Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1140vm-test-run-nixbot-gitlab> gitlab # [  191.693373] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.591Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1141vm-test-run-nixbot-gitlab> gitlab # [  191.696352] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.594Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1142vm-test-run-nixbot-gitlab> gitlab # [  191.699192] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.596Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1143vm-test-run-nixbot-gitlab> gitlab # [  191.702275] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.599Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1144vm-test-run-nixbot-gitlab> gitlab # [  191.704995] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.602Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1145vm-test-run-nixbot-gitlab> gitlab # [  191.707633] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.603Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1146vm-test-run-nixbot-gitlab> gitlab # [  191.710609] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.606Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1147vm-test-run-nixbot-gitlab> gitlab # [  191.713528] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.608Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1148vm-test-run-nixbot-gitlab> gitlab # [  191.716350] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.610Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1149vm-test-run-nixbot-gitlab> gitlab # [  191.718981] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.613Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1150vm-test-run-nixbot-gitlab> gitlab # [  191.721560] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.615Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1151vm-test-run-nixbot-gitlab> gitlab # [  191.724097] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.616Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1152vm-test-run-nixbot-gitlab> gitlab # [  191.726691] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.618Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1153vm-test-run-nixbot-gitlab> gitlab # [  191.730572] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.619Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1154vm-test-run-nixbot-gitlab> gitlab # [  191.733371] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.621Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1155vm-test-run-nixbot-gitlab> gitlab # [  191.735926] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.623Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1156vm-test-run-nixbot-gitlab> gitlab # [  191.738753] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.624Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1157vm-test-run-nixbot-gitlab> gitlab # [  191.741578] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.626Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1158vm-test-run-nixbot-gitlab> gitlab # [  191.744249] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.628Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1159vm-test-run-nixbot-gitlab> gitlab # [  191.746938] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.630Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1160vm-test-run-nixbot-gitlab> gitlab # [  191.749610] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.632Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1161vm-test-run-nixbot-gitlab> gitlab # [  191.752372] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.633Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1162vm-test-run-nixbot-gitlab> gitlab # [  191.754730] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.635Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1163vm-test-run-nixbot-gitlab> gitlab # [  191.757109] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.637Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1164vm-test-run-nixbot-gitlab> gitlab # [  191.759560] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.639Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1165vm-test-run-nixbot-gitlab> gitlab # [  191.762298] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.640Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1166vm-test-run-nixbot-gitlab> gitlab # [  191.764855] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.643Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1167vm-test-run-nixbot-gitlab> gitlab # [  191.767092] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.644Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1168vm-test-run-nixbot-gitlab> gitlab # [  191.769587] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.646Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1169vm-test-run-nixbot-gitlab> gitlab # [  191.771768] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.648Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1170vm-test-run-nixbot-gitlab> gitlab # [  191.774369] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.650Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1171vm-test-run-nixbot-gitlab> gitlab # [  191.776662] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.652Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1172vm-test-run-nixbot-gitlab> gitlab # [  191.778953] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.654Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1173vm-test-run-nixbot-gitlab> gitlab # [  191.781332] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.656Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1174vm-test-run-nixbot-gitlab> gitlab # [  191.783624] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.657Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1175vm-test-run-nixbot-gitlab> gitlab # [  191.786106] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.659Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1176vm-test-run-nixbot-gitlab> gitlab # [  191.788383] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.661Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1177vm-test-run-nixbot-gitlab> gitlab # [  191.790809] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.662Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1178vm-test-run-nixbot-gitlab> gitlab # [  191.792909] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.665Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1179vm-test-run-nixbot-gitlab> gitlab # [  191.795201] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.668Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1180vm-test-run-nixbot-gitlab> gitlab # [  191.797608] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.670Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1181vm-test-run-nixbot-gitlab> gitlab # [  191.799809] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.672Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1182vm-test-run-nixbot-gitlab> gitlab # [  191.802243] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.685Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1183vm-test-run-nixbot-gitlab> gitlab # [  191.804507] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.687Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1184vm-test-run-nixbot-gitlab> gitlab # [  191.806670] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.689Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1185vm-test-run-nixbot-gitlab> gitlab # [  191.808984] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.692Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1186vm-test-run-nixbot-gitlab> gitlab # [  191.810990] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.695Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1187vm-test-run-nixbot-gitlab> gitlab # [  191.813240] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.698Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1188vm-test-run-nixbot-gitlab> gitlab # [  191.815470] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.701Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1189vm-test-run-nixbot-gitlab> gitlab # [  191.817889] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.702Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1190vm-test-run-nixbot-gitlab> gitlab # [  191.819888] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.704Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1191vm-test-run-nixbot-gitlab> gitlab # [  191.862513] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.761Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1192vm-test-run-nixbot-gitlab> gitlab # [  191.865582] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:49:24.764Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1193vm-test-run-nixbot-gitlab> gitlab # [  199.590229] gitlab-workhorse[822]: time="2026-08-20T05:49:32Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1194vm-test-run-nixbot-gitlab> gitlab # [  209.601612] gitlab-workhorse[822]: time="2026-08-20T05:49:42Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1195vm-test-run-nixbot-gitlab> gitlab # [  219.621073] gitlab-workhorse[822]: time="2026-08-20T05:49:52Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1196vm-test-run-nixbot-gitlab> gitlab # [  229.631153] gitlab-workhorse[822]: time="2026-08-20T05:50:02Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1197vm-test-run-nixbot-gitlab> gitlab # [  237.377323] postgres[2929]: [2929] ERROR:  relation "table_without_models" does not exist1198vm-test-run-nixbot-gitlab> gitlab # [  237.380938] postgres[2929]: [2929] STATEMENT:  SELECT pg_get_serial_sequence('table_without_models', 'id')1199vm-test-run-nixbot-gitlab> gitlab # [  238.013793] postgres[2940]: [2940] ERROR:  relation "table_without_models" does not exist1200vm-test-run-nixbot-gitlab> gitlab # [  238.014132] postgres[2940]: [2940] STATEMENT:  SELECT pg_get_serial_sequence('table_without_models', 'id')1201vm-test-run-nixbot-gitlab> gitlab # [  239.650280] gitlab-workhorse[822]: time="2026-08-20T05:50:12Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1202vm-test-run-nixbot-gitlab> gitlab # [  242.523894] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:15.422Z","message":"Booted Rails 7.2.3.1 application in production environment"}1203vm-test-run-nixbot-gitlab> gitlab # [  242.526308] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:15.424Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1204vm-test-run-nixbot-gitlab> gitlab # [  242.532990] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:15.424Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1205vm-test-run-nixbot-gitlab> gitlab # [  242.538608] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:15.424Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1206vm-test-run-nixbot-gitlab> gitlab # [  242.545231] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:15.434Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1207vm-test-run-nixbot-gitlab> gitlab # [  243.858642] bundle[2015]: {"timestamp":"2026-08-20T05:50:16.755Z","pid":2015,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1208vm-test-run-nixbot-gitlab> gitlab # [  243.864845] bundle[2015]: {"timestamp":"2026-08-20T05:50:16.755Z","pid":2015,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1209vm-test-run-nixbot-gitlab> gitlab # [  243.870329] bundle[2015]: {"timestamp":"2026-08-20T05:50:16.755Z","pid":2015,"message":"! #\u003cThread:0x0000ee1649c92130 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1210vm-test-run-nixbot-gitlab> gitlab # [  243.887508] bundle[2015]: {"timestamp":"2026-08-20T05:50:16.755Z","pid":2015,"message":"! #\u003cThread:0x0000ee1649ed4fd8 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1211vm-test-run-nixbot-gitlab> gitlab # [  243.903410] bundle[2015]: {"timestamp":"2026-08-20T05:50:16.756Z","pid":2015,"message":"Use Ctrl-C to stop"}1212vm-test-run-nixbot-gitlab> gitlab # [  243.907264] bundle[2015]: {"timestamp":"2026-08-20T05:50:16.757Z","pid":2015,"message":"Sending status to systemd every 1.0 sec"}1213vm-test-run-nixbot-gitlab> gitlab # [  245.055134] bundle[2015]: {"timestamp":"2026-08-20T05:50:17.953Z","pid":2015,"message":"- Worker 1 (PID: 3046) booted in 1.11s, phase: 0"}1214vm-test-run-nixbot-gitlab> gitlab # [  245.085996] bundle[2015]: {"timestamp":"2026-08-20T05:50:17.985Z","pid":2015,"message":"- Worker 0 (PID: 3042) booted in 1.17s, phase: 0"}1215vm-test-run-nixbot-gitlab> gitlab # [  245.091713] systemd[1]: Started gitlab.service.1216vm-test-run-nixbot-gitlab> gitlab # [  245.092811] systemd[1]: Reached target Common target for all GitLab services..1217vm-test-run-nixbot-gitlab> gitlab # [  245.098455] systemd[1]: Starting setup-gitlab.service...1218vm-test-run-nixbot-gitlab> gitlab # [  245.129375] setup-gitlab-start[3079]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1219vm-test-run-nixbot-gitlab> gitlab # [  245.315247] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:18.212Z","message":"Cleaning working queues"}1220vm-test-run-nixbot-gitlab> gitlab # [  245.322952] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:18.218Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e93659e4390b1a3b04363c53","created_at":"2026-08-20T05:48:20.257Z","trace_propagation_headers":{"sentry-trace":"247e7ab67edb4701b0358ac30539a9bf-7cedb129ea884af1","baggage":"sentry-trace_id=247e7ab67edb4701b0358ac30539a9bf,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"f5dde10edbb8172e8ee4308502c02246","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:20.268Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e93659e4390b1a3b04363c53: start","job_status":"start","queue_duration_s":117.949867,"scheduling_latency_s":117.949986}1221vm-test-run-nixbot-gitlab> gitlab # [  245.690021] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:18.588Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"e93659e4390b1a3b04363c53","created_at":"2026-08-20T05:48:20.257Z","trace_propagation_headers":{"sentry-trace":"247e7ab67edb4701b0358ac30539a9bf-7cedb129ea884af1","baggage":"sentry-trace_id=247e7ab67edb4701b0358ac30539a9bf,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"f5dde10edbb8172e8ee4308502c02246","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:48:20.268Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-e93659e4390b1a3b04363c53: done: 0.369509 sec","job_status":"done","queue_duration_s":117.949867,"scheduling_latency_s":117.949986,"redis_calls":24,"redis_duration_s":0.011265,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005451,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003902,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001912,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.192117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20596562000000002,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.369509,"completed_at":"2026-08-20T05:50:18.587Z","load_balancing_strategy":"primary","db_duration_s":0.099903,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1222vm-test-run-nixbot-gitlab> gitlab # [  249.306610] gitlab-workhorse[822]: gitlab 2001:db8:1::1 - - [2026/08/20:05:50:22 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 41481223vm-test-run-nixbot-gitlab> gitlab # [  249.312603] setup-gitlab-start[3079]: + TOKEN=nixbot-test-token-of-20-chars1224vm-test-run-nixbot-gitlab> gitlab # [  249.315616] setup-gitlab-start[3079]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n  ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n  Rails.cache.clear\n  token = User.find_by_username(\'root\').personal_access_tokens.create!(\n    name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n  token.set_token(\'nixbot-test-token-of-20-chars\')\n  token.save!\n'1225vm-test-run-nixbot-gitlab> gitlab # [  249.333301] runuser[3112]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1226vm-test-run-nixbot-gitlab> gitlab # [  249.912447] setup-gitlab-start[3113]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1227vm-test-run-nixbot-gitlab> gitlab # [  249.919106] setup-gitlab-start[3113]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1228vm-test-run-nixbot-gitlab> gitlab # [  249.925500] setup-gitlab-start[3113]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1229vm-test-run-nixbot-gitlab> gitlab # [  250.810108] setup-gitlab-start[3113]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1230vm-test-run-nixbot-gitlab> gitlab # [  250.810500] setup-gitlab-start[3113]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1231vm-test-run-nixbot-gitlab> gitlab # [  250.813495] setup-gitlab-start[3113]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1232vm-test-run-nixbot-gitlab> gitlab # [  259.112273] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.009Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"b981d9eef9ed2b4a9851d494","created_at":"2026-08-20T05:50:31.903Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b69d02a5a20dd6462166371c5c0ea7b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.006Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-b981d9eef9ed2b4a9851d494: start","job_status":"start","queue_duration_s":0.003304,"scheduling_latency_s":0.003359}1233vm-test-run-nixbot-gitlab> gitlab # [  259.293368] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"b981d9eef9ed2b4a9851d494","created_at":"2026-08-20T05:50:31.903Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5b69d02a5a20dd6462166371c5c0ea7b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.006Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-b981d9eef9ed2b4a9851d494: done: 0.181564 sec","job_status":"done","queue_duration_s":0.003304,"scheduling_latency_s":0.003359,"redis_calls":10,"redis_duration_s":0.0102,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007792,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001408,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00169246,"duration_s":0.181564,"completed_at":"2026-08-20T05:50:32.190Z","load_balancing_strategy":"primary","db_duration_s":0.051192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1234vm-test-run-nixbot-gitlab> gitlab # [  259.386101] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.197Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"42f050d290e731fb50383227","created_at":"2026-08-20T05:50:32.028Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17cb362161c1c66cf1596a94b85a085c","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.064Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-42f050d290e731fb50383227: start","job_status":"start","queue_duration_s":0.133716,"scheduling_latency_s":0.133771}1235vm-test-run-nixbot-gitlab> gitlab # [  259.404680] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"42f050d290e731fb50383227","created_at":"2026-08-20T05:50:32.028Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17cb362161c1c66cf1596a94b85a085c","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.064Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-42f050d290e731fb50383227: done: 0.069217 sec","job_status":"done","queue_duration_s":0.133716,"scheduling_latency_s":0.133771,"redis_calls":10,"redis_duration_s":0.004065,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001222,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0021,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000743,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004817,"duration_s":0.069217,"completed_at":"2026-08-20T05:50:32.266Z","load_balancing_strategy":"primary","db_duration_s":0.001244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236vm-test-run-nixbot-gitlab> gitlab # [  259.456070] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"2810db71eac4481109d76ef7","created_at":"2026-08-20T05:50:32.071Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed05095c0e98064d2c07133d30a38cb8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.085Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-2810db71eac4481109d76ef7: start","job_status":"start","queue_duration_s":0.187534,"scheduling_latency_s":0.18758}1237vm-test-run-nixbot-gitlab> gitlab # [  259.471219] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.333Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"2810db71eac4481109d76ef7","created_at":"2026-08-20T05:50:32.071Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ed05095c0e98064d2c07133d30a38cb8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.085Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-2810db71eac4481109d76ef7: done: 0.061041 sec","job_status":"done","queue_duration_s":0.187534,"scheduling_latency_s":0.18758,"redis_calls":12,"redis_duration_s":0.007966,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005286,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002036,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000644,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000547,"duration_s":0.061041,"completed_at":"2026-08-20T05:50:32.333Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005909,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1238vm-test-run-nixbot-gitlab> gitlab # [  259.514203] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.337Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"553b34bccaf9d9ac512b4c96","created_at":"2026-08-20T05:50:32.093Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b998d8d0abbe5cedbad5089341d389bc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:50:32.107Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-553b34bccaf9d9ac512b4c96: start","job_status":"start","queue_duration_s":0.230608,"scheduling_latency_s":0.230657}1239vm-test-run-nixbot-gitlab> gitlab # [  259.527704] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.411Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1240vm-test-run-nixbot-gitlab> gitlab # [  259.577135] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.474Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"553b34bccaf9d9ac512b4c96","created_at":"2026-08-20T05:50:32.093Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b998d8d0abbe5cedbad5089341d389bc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:50:32.107Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-553b34bccaf9d9ac512b4c96: done: 0.137141 sec","job_status":"done","queue_duration_s":0.230608,"scheduling_latency_s":0.230657,"redis_calls":10,"redis_duration_s":0.015364000000000001,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002263,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001151,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00548524,"duration_s":0.137141,"completed_at":"2026-08-20T05:50:32.474Z","load_balancing_strategy":"primary","db_duration_s":0.002483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241vm-test-run-nixbot-gitlab> gitlab # [  259.648704] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.480Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"76500bb4d925526d2e8344aa","created_at":"2026-08-20T05:50:32.118Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4af4a5b294f9a254b4f3d09f9dea63a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.133Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-76500bb4d925526d2e8344aa: start","job_status":"start","queue_duration_s":0.347446,"scheduling_latency_s":0.347513}1242vm-test-run-nixbot-gitlab> gitlab # [  259.665005] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.525Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1243vm-test-run-nixbot-gitlab> gitlab # [  259.668729] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"76500bb4d925526d2e8344aa","created_at":"2026-08-20T05:50:32.118Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4af4a5b294f9a254b4f3d09f9dea63a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.133Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-76500bb4d925526d2e8344aa: done: 0.060467 sec","job_status":"done","queue_duration_s":0.347446,"scheduling_latency_s":0.347513,"redis_calls":10,"redis_duration_s":0.0028840000000000003,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000585,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000622,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035108,"duration_s":0.060467,"completed_at":"2026-08-20T05:50:32.540Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002498,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1244vm-test-run-nixbot-gitlab> gitlab # [  259.711898] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.542Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2dd8f042d2fb4550b65aaeec","created_at":"2026-08-20T05:50:32.175Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0caea75a3510f5f6b850fd0c0a0f654","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.194Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2dd8f042d2fb4550b65aaeec: start","job_status":"start","queue_duration_s":0.34792,"scheduling_latency_s":0.347948}1245vm-test-run-nixbot-gitlab> gitlab # [  259.728516] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.627Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"2dd8f042d2fb4550b65aaeec","created_at":"2026-08-20T05:50:32.175Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0caea75a3510f5f6b850fd0c0a0f654","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.194Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-2dd8f042d2fb4550b65aaeec: done: 0.084231 sec","job_status":"done","queue_duration_s":0.34792,"scheduling_latency_s":0.347948,"redis_calls":12,"redis_duration_s":0.0026939999999999998,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000376,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001237,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001081,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00073334,"exclusive_lock_hold_duration_s":0.0292625,"duration_s":0.084231,"completed_at":"2026-08-20T05:50:32.626Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024518,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1246vm-test-run-nixbot-gitlab> gitlab # [  259.771922] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.629Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2d59645d01c37f89de0e5963","created_at":"2026-08-20T05:50:32.259Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"290da9fc7c0e3f87f1565af08bca182d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.303Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2d59645d01c37f89de0e5963: start","job_status":"start","queue_duration_s":0.326215,"scheduling_latency_s":0.326247}1247vm-test-run-nixbot-gitlab> gitlab # [  259.821497] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.719Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"2d59645d01c37f89de0e5963","created_at":"2026-08-20T05:50:32.259Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"290da9fc7c0e3f87f1565af08bca182d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.303Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-2d59645d01c37f89de0e5963: done: 0.089728 sec","job_status":"done","queue_duration_s":0.326215,"scheduling_latency_s":0.326247,"redis_calls":12,"redis_duration_s":0.009058,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000467,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004939,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003652,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00068488,"exclusive_lock_hold_duration_s":0.02303346,"duration_s":0.089728,"completed_at":"2026-08-20T05:50:32.719Z","load_balancing_strategy":"primary","db_duration_s":0.016774,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1248vm-test-run-nixbot-gitlab> gitlab # [  259.875530] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:32.738Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"f8389730e7c67fcfe59b2b13","created_at":"2026-08-20T05:50:32.355Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a8b50f3830990abbeef20380f2b9917","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.375Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-f8389730e7c67fcfe59b2b13: start","job_status":"start","queue_duration_s":0.363389,"scheduling_latency_s":0.363445}1249vm-test-run-nixbot-gitlab> gitlab # [  260.105561] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.003Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"f8389730e7c67fcfe59b2b13","created_at":"2026-08-20T05:50:32.355Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5a8b50f3830990abbeef20380f2b9917","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.375Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-f8389730e7c67fcfe59b2b13: done: 0.264977 sec","job_status":"done","queue_duration_s":0.363389,"scheduling_latency_s":0.363445,"redis_calls":17,"redis_duration_s":0.041947,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.014948,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00996,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.011615,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005424,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00363696,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.264977,"completed_at":"2026-08-20T05:50:33.003Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011897,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1250vm-test-run-nixbot-gitlab> gitlab # [  260.190034] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.015Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerExpirationPolicyWorker","jid":"3367434b0a23d4d26dc0a85e","created_at":"2026-08-20T05:50:32.435Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4a64f742d5dfb818ae0debe4fad7bb0","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ba5eeda814b310e5e806d97a55d657076d1f5f4bfe3538607468cb1befa65b3c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.469Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicyWorker JID-3367434b0a23d4d26dc0a85e: start","job_status":"start","queue_duration_s":0.545878,"scheduling_latency_s":0.545928}1251vm-test-run-nixbot-gitlab> gitlab # [  260.442034] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.339Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerExpirationPolicyWorker","jid":"3367434b0a23d4d26dc0a85e","created_at":"2026-08-20T05:50:32.435Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b4a64f742d5dfb818ae0debe4fad7bb0","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ba5eeda814b310e5e806d97a55d657076d1f5f4bfe3538607468cb1befa65b3c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.469Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicyWorker JID-3367434b0a23d4d26dc0a85e: done: 0.324408 sec","job_status":"done","queue_duration_s":0.545878,"scheduling_latency_s":0.545928,"redis_calls":21,"redis_duration_s":0.053429,"redis_read_bytes":24,"redis_write_bytes":5391,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.0063,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":724,"redis_queues_calls":2,"redis_queues_duration_s":0.001503,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3279,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.026215,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":782,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.019411,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":606,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04801736,"extra.container_expiration_policy_worker.cleanup_required_count":0,"extra.container_expiration_policy_worker.cleanup_unfinished_count":0,"extra.container_expiration_policy_worker.cleanup_total_count":0,"duration_s":0.324408,"completed_at":"2026-08-20T05:50:33.339Z","load_balancing_strategy":"primary","db_duration_s":0.048654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1252vm-test-run-nixbot-gitlab> gitlab # [  260.505904] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.354Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"23c725a7dba397b36ab40cae","created_at":"2026-08-20T05:50:32.490Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c08642ee504feeb5998affb966254ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.537Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-23c725a7dba397b36ab40cae: start","job_status":"start","queue_duration_s":0.816545,"scheduling_latency_s":0.816601}1253vm-test-run-nixbot-gitlab> gitlab # [  260.626075] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.524Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"23c725a7dba397b36ab40cae","created_at":"2026-08-20T05:50:32.490Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c08642ee504feeb5998affb966254ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.537Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-23c725a7dba397b36ab40cae: done: 0.169863 sec","job_status":"done","queue_duration_s":0.816545,"scheduling_latency_s":0.816601,"redis_calls":19,"redis_duration_s":0.038058,"redis_read_bytes":22,"redis_write_bytes":4781,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005812,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.002653,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.023913,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00568,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.071306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0017587,"duration_s":0.169863,"completed_at":"2026-08-20T05:50:33.523Z","load_balancing_strategy":"primary","db_duration_s":0.013019,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1254vm-test-run-nixbot-gitlab> gitlab # [  260.715463] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.531Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"b7b9b3b6b7ef2b08e6842eba","created_at":"2026-08-20T05:50:32.557Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f640ee8b4205e9d3fba7b33870372efe","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.589Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-b7b9b3b6b7ef2b08e6842eba: start","job_status":"start","queue_duration_s":0.942577,"scheduling_latency_s":0.942637}1255vm-test-run-nixbot-gitlab> gitlab # [  260.778414] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.676Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"b7b9b3b6b7ef2b08e6842eba","created_at":"2026-08-20T05:50:32.557Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f640ee8b4205e9d3fba7b33870372efe","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.589Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-b7b9b3b6b7ef2b08e6842eba: done: 0.144733 sec","job_status":"done","queue_duration_s":0.942577,"scheduling_latency_s":0.942637,"redis_calls":10,"redis_duration_s":0.005138,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000776,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003353,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001009,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046503,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00097832,"duration_s":0.144733,"completed_at":"2026-08-20T05:50:33.676Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007861,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256vm-test-run-nixbot-gitlab> gitlab # [  260.882888] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.679Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4fd806092a8c79c10999f10a","created_at":"2026-08-20T05:50:32.602Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fbd8a82de539e17cd70dd02d34c0d546","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.636Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4fd806092a8c79c10999f10a: start","job_status":"start","queue_duration_s":1.043508,"scheduling_latency_s":1.043553}1257vm-test-run-nixbot-gitlab> gitlab # [  260.903703] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.703Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1258vm-test-run-nixbot-gitlab> gitlab # [  260.908436] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.715Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4fd806092a8c79c10999f10a","created_at":"2026-08-20T05:50:32.602Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fbd8a82de539e17cd70dd02d34c0d546","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.636Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4fd806092a8c79c10999f10a: done: 0.036339 sec","job_status":"done","queue_duration_s":1.043508,"scheduling_latency_s":1.043553,"redis_calls":10,"redis_duration_s":0.003558,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000787,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000846,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055584,"duration_s":0.036339,"completed_at":"2026-08-20T05:50:33.715Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000948,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1259vm-test-run-nixbot-gitlab> gitlab # [  260.953252] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7653171a42a61293490246ad","created_at":"2026-08-20T05:50:32.667Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"223e3dbf327defdf6c13945405350ca7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.690Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7653171a42a61293490246ad: start","job_status":"start","queue_duration_s":1.027549,"scheduling_latency_s":1.027581}1260vm-test-run-nixbot-gitlab> gitlab # [  260.967793] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.789Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"7653171a42a61293490246ad","created_at":"2026-08-20T05:50:32.667Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"223e3dbf327defdf6c13945405350ca7","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.690Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-7653171a42a61293490246ad: done: 0.07066 sec","job_status":"done","queue_duration_s":1.027549,"scheduling_latency_s":1.027581,"redis_calls":13,"redis_duration_s":0.005606,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00082,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002878,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001908,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0234723,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.07066,"completed_at":"2026-08-20T05:50:33.788Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005251,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1261vm-test-run-nixbot-gitlab> gitlab # [  261.012502] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.793Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2f2942fe24112a44dd90be96","created_at":"2026-08-20T05:50:32.709Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"318072b2ba2a694ec3ae21b0972fe7ce","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.724Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2f2942fe24112a44dd90be96: start","job_status":"start","queue_duration_s":1.068033,"scheduling_latency_s":1.068074}1262vm-test-run-nixbot-gitlab> gitlab # [  261.028050] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.837Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2f2942fe24112a44dd90be96","created_at":"2026-08-20T05:50:32.709Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"318072b2ba2a694ec3ae21b0972fe7ce","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.724Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2f2942fe24112a44dd90be96: done: 0.044253 sec","job_status":"done","queue_duration_s":1.068033,"scheduling_latency_s":1.068074,"redis_calls":12,"redis_duration_s":0.004202,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000778,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001546,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008854,"exclusive_lock_hold_duration_s":0.0058708599999999994,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.044253,"completed_at":"2026-08-20T05:50:33.837Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003024,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1263vm-test-run-nixbot-gitlab> gitlab # [  261.071250] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.840Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"3fff7a6217dbdecc2a66fbd5","created_at":"2026-08-20T05:50:32.730Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f011e4fc893127608a6f7e5fbe2d4c6a","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.745Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-3fff7a6217dbdecc2a66fbd5: start","job_status":"start","queue_duration_s":1.094976,"scheduling_latency_s":1.09501}1264vm-test-run-nixbot-gitlab> gitlab # [  261.084983] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.890Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"3fff7a6217dbdecc2a66fbd5","created_at":"2026-08-20T05:50:32.730Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f011e4fc893127608a6f7e5fbe2d4c6a","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.745Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-3fff7a6217dbdecc2a66fbd5: done: 0.050931 sec","job_status":"done","queue_duration_s":1.094976,"scheduling_latency_s":1.09501,"redis_calls":10,"redis_duration_s":0.004216,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000798,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0026,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000818,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052948,"duration_s":0.050931,"completed_at":"2026-08-20T05:50:33.890Z","load_balancing_strategy":"primary","db_duration_s":0.008269,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1265vm-test-run-nixbot-gitlab> gitlab # [  261.126610] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.893Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"24e1b72dd463f2e399d9b625","created_at":"2026-08-20T05:50:32.759Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2202e19dfb4673548f0a6a93208accb3","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.767Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-24e1b72dd463f2e399d9b625: start","job_status":"start","queue_duration_s":1.126012,"scheduling_latency_s":1.126044}1266vm-test-run-nixbot-gitlab> gitlab # [  261.140114] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.929Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"24e1b72dd463f2e399d9b625","created_at":"2026-08-20T05:50:32.759Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2202e19dfb4673548f0a6a93208accb3","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.767Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-24e1b72dd463f2e399d9b625: done: 0.036053 sec","job_status":"done","queue_duration_s":1.126012,"scheduling_latency_s":1.126044,"redis_calls":10,"redis_duration_s":0.002909,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000632,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001688,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000589,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003706,"duration_s":0.036053,"completed_at":"2026-08-20T05:50:33.929Z","load_balancing_strategy":"primary","db_duration_s":0.003748,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1267vm-test-run-nixbot-gitlab> gitlab # [  261.181133] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:33.931Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7889400d18dfe523f7dfb386","created_at":"2026-08-20T05:50:32.774Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d38b4b23593b7352803e00737fb93f9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.783Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7889400d18dfe523f7dfb386: start","job_status":"start","queue_duration_s":1.148508,"scheduling_latency_s":1.148536}1268vm-test-run-nixbot-gitlab> gitlab # [  261.195985] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.024Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7889400d18dfe523f7dfb386","created_at":"2026-08-20T05:50:32.774Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d38b4b23593b7352803e00737fb93f9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.783Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7889400d18dfe523f7dfb386: done: 0.092938 sec","job_status":"done","queue_duration_s":1.148508,"scheduling_latency_s":1.148536,"redis_calls":14,"redis_duration_s":0.003225,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001067,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00097,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00061228,"exclusive_lock_hold_duration_s":0.06561462000000001,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.092938,"completed_at":"2026-08-20T05:50:34.024Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028782,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1269vm-test-run-nixbot-gitlab> gitlab # [  261.242760] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.026Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"5793085759569d08de577943","created_at":"2026-08-20T05:50:32.799Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a01215473e00c81bb8718829ad7e8ca","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.807Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-5793085759569d08de577943: start","job_status":"start","queue_duration_s":1.218887,"scheduling_latency_s":1.218909}1270vm-test-run-nixbot-gitlab> gitlab # [  261.435862] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.334Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"5793085759569d08de577943","created_at":"2026-08-20T05:50:32.799Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8a01215473e00c81bb8718829ad7e8ca","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.807Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-5793085759569d08de577943: done: 0.307753 sec","job_status":"done","queue_duration_s":1.218887,"scheduling_latency_s":1.218909,"redis_calls":565,"redis_duration_s":0.055271,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000838,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.054155,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.283717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030206,"duration_s":0.307753,"completed_at":"2026-08-20T05:50:34.334Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000881,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1271vm-test-run-nixbot-gitlab> gitlab # [  261.532271] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9e665c31c15a78a6e6039c8d","created_at":"2026-08-20T05:50:32.811Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.818Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9e665c31c15a78a6e6039c8d: start","job_status":"start","queue_duration_s":1.517404,"scheduling_latency_s":1.517429}1272vm-test-run-nixbot-gitlab> gitlab # [  261.554965] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9e665c31c15a78a6e6039c8d","created_at":"2026-08-20T05:50:32.811Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.818Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9e665c31c15a78a6e6039c8d: done: 0.11778 sec","job_status":"done","queue_duration_s":1.517404,"scheduling_latency_s":1.517429,"redis_calls":71,"redis_duration_s":0.015165000000000001,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00165,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001105,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.011851,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000559,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033554,"duration_s":0.11778,"completed_at":"2026-08-20T05:50:34.453Z","load_balancing_strategy":"primary","db_duration_s":0.002279,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1273vm-test-run-nixbot-gitlab> gitlab # [  261.614122] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.455Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4c4571c2f12e1fde40ac4aa8","created_at":"2026-08-20T05:50:32.823Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c20a6cd5660bee6c1cea83a647ffb8c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:50:32.845Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4c4571c2f12e1fde40ac4aa8: start","job_status":"start","queue_duration_s":1.610212,"scheduling_latency_s":1.610235}1274vm-test-run-nixbot-gitlab> gitlab # [  261.629088] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"4c4571c2f12e1fde40ac4aa8","created_at":"2026-08-20T05:50:32.823Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c20a6cd5660bee6c1cea83a647ffb8c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:50:32.845Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-4c4571c2f12e1fde40ac4aa8: done: 0.041417 sec","job_status":"done","queue_duration_s":1.610212,"scheduling_latency_s":1.610235,"redis_calls":10,"redis_duration_s":0.002744,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000569,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001603,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047702,"duration_s":0.041417,"completed_at":"2026-08-20T05:50:34.497Z","load_balancing_strategy":"primary","db_duration_s":0.00847,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1275vm-test-run-nixbot-gitlab> gitlab # [  261.671297] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.498Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"e0c6864f30fc585bb6ee5e8d","created_at":"2026-08-20T05:50:32.867Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c90e6d5b4a6d4c0817ca4e51ced5d55","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.892Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-e0c6864f30fc585bb6ee5e8d: start","job_status":"start","queue_duration_s":1.606664,"scheduling_latency_s":1.606684}1276vm-test-run-nixbot-gitlab> gitlab # [  261.684724] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.521Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"e0c6864f30fc585bb6ee5e8d","created_at":"2026-08-20T05:50:32.867Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c90e6d5b4a6d4c0817ca4e51ced5d55","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.892Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-e0c6864f30fc585bb6ee5e8d: done: 0.022649 sec","job_status":"done","queue_duration_s":1.606664,"scheduling_latency_s":1.606684,"redis_calls":12,"redis_duration_s":0.002983,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000562,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000594,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001329,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032266,"duration_s":0.022649,"completed_at":"2026-08-20T05:50:34.521Z","load_balancing_strategy":"primary","db_duration_s":0.000747,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1277vm-test-run-nixbot-gitlab> gitlab # [  261.726761] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9eeec15b757a335e3314b491","created_at":"2026-08-20T05:50:32.956Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"928a260bd4802016f9d1e032f683b114","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.981Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9eeec15b757a335e3314b491: start","job_status":"start","queue_duration_s":1.541857,"scheduling_latency_s":1.541875}1278vm-test-run-nixbot-gitlab> gitlab # [  261.740731] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.577Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"9eeec15b757a335e3314b491","created_at":"2026-08-20T05:50:32.956Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"928a260bd4802016f9d1e032f683b114","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:32.981Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-9eeec15b757a335e3314b491: done: 0.054211 sec","job_status":"done","queue_duration_s":1.541857,"scheduling_latency_s":1.541875,"redis_calls":10,"redis_duration_s":0.002899,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000558,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000593,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051164,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.054211,"completed_at":"2026-08-20T05:50:34.577Z","load_balancing_strategy":"primary","db_duration_s":0.027088,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279vm-test-run-nixbot-gitlab> gitlab # [  261.782812] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.579Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"9e980a10f990068eca77119f","created_at":"2026-08-20T05:50:33.000Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3a6ff9db919d7b0d1b44d8b82f45443","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.021Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-9e980a10f990068eca77119f: start","job_status":"start","queue_duration_s":1.557395,"scheduling_latency_s":1.557414}1280vm-test-run-nixbot-gitlab> gitlab # [  261.797495] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.611Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"9e980a10f990068eca77119f","created_at":"2026-08-20T05:50:33.000Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3a6ff9db919d7b0d1b44d8b82f45443","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.021Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-9e980a10f990068eca77119f: done: 0.032268 sec","job_status":"done","queue_duration_s":1.557395,"scheduling_latency_s":1.557414,"redis_calls":13,"redis_duration_s":0.003377,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000577,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001405,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001395,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032572,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.032268,"completed_at":"2026-08-20T05:50:34.611Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005596,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1281vm-test-run-nixbot-gitlab> gitlab # [  261.841815] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.613Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f1eeffe75bf48e91d187d361","created_at":"2026-08-20T05:50:33.042Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fdce9cb7951abaa344acbff344e10351","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.055Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f1eeffe75bf48e91d187d361: start","job_status":"start","queue_duration_s":1.557903,"scheduling_latency_s":1.557923}1282vm-test-run-nixbot-gitlab> gitlab # [  261.856189] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"f1eeffe75bf48e91d187d361","created_at":"2026-08-20T05:50:33.042Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fdce9cb7951abaa344acbff344e10351","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.055Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-f1eeffe75bf48e91d187d361: done: 0.021782 sec","job_status":"done","queue_duration_s":1.557903,"scheduling_latency_s":1.557923,"redis_calls":10,"redis_duration_s":0.002454,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00058,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001393,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000481,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031332,"duration_s":0.021782,"completed_at":"2026-08-20T05:50:34.634Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000757,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1283vm-test-run-nixbot-gitlab> gitlab # [  261.899259] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.636Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0030368b4f03b003e8605017","created_at":"2026-08-20T05:50:33.067Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb63a38f1fa3d1f606d1d48b2a93f4be","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.087Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0030368b4f03b003e8605017: start","job_status":"start","queue_duration_s":1.548812,"scheduling_latency_s":1.54883}1284vm-test-run-nixbot-gitlab> gitlab # [  261.913462] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.681Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"0030368b4f03b003e8605017","created_at":"2026-08-20T05:50:33.067Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb63a38f1fa3d1f606d1d48b2a93f4be","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.087Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-0030368b4f03b003e8605017: done: 0.045031 sec","job_status":"done","queue_duration_s":1.548812,"scheduling_latency_s":1.54883,"redis_calls":10,"redis_duration_s":0.002731,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000518,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001626,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000587,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018877,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00040332,"duration_s":0.045031,"completed_at":"2026-08-20T05:50:34.681Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017755,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285vm-test-run-nixbot-gitlab> gitlab # [  261.955270] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.683Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"aa206ead0a76f441bf86faa2","created_at":"2026-08-20T05:50:33.098Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6123232e88cc322d97010af3ee59fd8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:50:33.119Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-aa206ead0a76f441bf86faa2: start","job_status":"start","queue_duration_s":1.564601,"scheduling_latency_s":1.56462}1286vm-test-run-nixbot-gitlab> gitlab # [  261.968903] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.697Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1287vm-test-run-nixbot-gitlab> gitlab # [  261.972110] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.704Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"aa206ead0a76f441bf86faa2","created_at":"2026-08-20T05:50:33.098Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e6123232e88cc322d97010af3ee59fd8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:50:33.119Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-aa206ead0a76f441bf86faa2: done: 0.021206 sec","job_status":"done","queue_duration_s":1.564601,"scheduling_latency_s":1.56462,"redis_calls":10,"redis_duration_s":0.002536,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000546,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001425,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000565,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036852,"duration_s":0.021206,"completed_at":"2026-08-20T05:50:34.704Z","load_balancing_strategy":"primary","db_duration_s":0.000735,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288vm-test-run-nixbot-gitlab> gitlab # [  262.012589] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"541092ba45050ace1a61f749","created_at":"2026-08-20T05:50:33.151Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ad458f79b2c14430b271845e3f45df2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.173Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-541092ba45050ace1a61f749: start","job_status":"start","queue_duration_s":1.533313,"scheduling_latency_s":1.53333}1289vm-test-run-nixbot-gitlab> gitlab # [  262.026861] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.743Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"541092ba45050ace1a61f749","created_at":"2026-08-20T05:50:33.151Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ad458f79b2c14430b271845e3f45df2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.173Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-541092ba45050ace1a61f749: done: 0.036525 sec","job_status":"done","queue_duration_s":1.533313,"scheduling_latency_s":1.53333,"redis_calls":20,"redis_duration_s":0.004452,"redis_read_bytes":23,"redis_write_bytes":4315,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001455,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000686,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2020,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001856,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000455,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003058,"duration_s":0.036525,"completed_at":"2026-08-20T05:50:34.742Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001806,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1290vm-test-run-nixbot-gitlab> gitlab # [  262.071441] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.744Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2d71d8ef645365529fa81194","created_at":"2026-08-20T05:50:33.191Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47b5c98b957737dedb9277169d0fbbd0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.213Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2d71d8ef645365529fa81194: start","job_status":"start","queue_duration_s":1.530991,"scheduling_latency_s":1.531009}1291vm-test-run-nixbot-gitlab> gitlab # [  262.086098] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.757Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1292vm-test-run-nixbot-gitlab> gitlab # [  262.089893] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.774Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"2d71d8ef645365529fa81194","created_at":"2026-08-20T05:50:33.191Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47b5c98b957737dedb9277169d0fbbd0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.213Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-2d71d8ef645365529fa81194: done: 0.029654 sec","job_status":"done","queue_duration_s":1.530991,"scheduling_latency_s":1.531009,"redis_calls":10,"redis_duration_s":0.003527,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000503,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00234,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000684,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014647,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0010512,"duration_s":0.029654,"completed_at":"2026-08-20T05:50:34.774Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000591,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293vm-test-run-nixbot-gitlab> gitlab # [  262.131865] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"84887d5506acc4fe2e9e89dc","created_at":"2026-08-20T05:50:33.179Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-eecfe5caff014b09","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b4a64f742d5dfb818ae0debe4fad7bb0","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.220Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-84887d5506acc4fe2e9e89dc: start","job_status":"start","queue_duration_s":1.557762,"scheduling_latency_s":1.557806}1294vm-test-run-nixbot-gitlab> gitlab # [  262.145448] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"84887d5506acc4fe2e9e89dc","created_at":"2026-08-20T05:50:33.179Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-eecfe5caff014b09","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b4a64f742d5dfb818ae0debe4fad7bb0","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.220Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-84887d5506acc4fe2e9e89dc: done: 0.088326 sec","job_status":"done","queue_duration_s":1.557762,"scheduling_latency_s":1.557806,"redis_calls":13,"redis_duration_s":0.00546,"redis_read_bytes":12,"redis_write_bytes":1785,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000585,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":365,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002254,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":559,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002621,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":861,"db_count":5,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.01,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.01,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007817,"duration_s":0.088326,"completed_at":"2026-08-20T05:50:34.866Z","load_balancing_strategy":"primary","db_duration_s":0.008541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295vm-test-run-nixbot-gitlab> gitlab # [  262.187148] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.869Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"f997d246ab8ea29a399d51cb","created_at":"2026-08-20T05:50:33.179Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-eecfe5caff014b09","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b4a64f742d5dfb818ae0debe4fad7bb0","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.220Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-f997d246ab8ea29a399d51cb: start","job_status":"start","queue_duration_s":1.6489,"scheduling_latency_s":1.648941}1296vm-test-run-nixbot-gitlab> gitlab # [  262.201229] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"f997d246ab8ea29a399d51cb","created_at":"2026-08-20T05:50:33.179Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-eecfe5caff014b09","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b4a64f742d5dfb818ae0debe4fad7bb0","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.220Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-f997d246ab8ea29a399d51cb: done: 0.053267 sec","job_status":"done","queue_duration_s":1.6489,"scheduling_latency_s":1.648941,"redis_calls":10,"redis_duration_s":0.0035440000000000003,"redis_read_bytes":8,"redis_write_bytes":1310,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001358,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":449,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002186,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":861,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053267,"completed_at":"2026-08-20T05:50:34.922Z","load_balancing_strategy":"primary","db_duration_s":0.006232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297vm-test-run-nixbot-gitlab> gitlab # [  262.240941] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"8d58afe675cfcc4eb3734556","created_at":"2026-08-20T05:50:33.179Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-eecfe5caff014b09","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b4a64f742d5dfb818ae0debe4fad7bb0","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.220Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-8d58afe675cfcc4eb3734556: start","job_status":"start","queue_duration_s":1.704371,"scheduling_latency_s":1.704404}1298vm-test-run-nixbot-gitlab> gitlab # [  262.254269] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"8d58afe675cfcc4eb3734556","created_at":"2026-08-20T05:50:33.179Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-eecfe5caff014b09","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b4a64f742d5dfb818ae0debe4fad7bb0","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.220Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-8d58afe675cfcc4eb3734556: done: 0.042418 sec","job_status":"done","queue_duration_s":1.704371,"scheduling_latency_s":1.704404,"redis_calls":10,"redis_duration_s":0.003151,"redis_read_bytes":8,"redis_write_bytes":1310,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001446,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":449,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001705,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":861,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042418,"completed_at":"2026-08-20T05:50:34.966Z","load_balancing_strategy":"primary","db_duration_s":0.005651,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299vm-test-run-nixbot-gitlab> gitlab # [  262.295424] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:34.969Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"b4d67fcbfd6f9d987ad4100e","created_at":"2026-08-20T05:50:33.179Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-eecfe5caff014b09","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b4a64f742d5dfb818ae0debe4fad7bb0","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.220Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-b4d67fcbfd6f9d987ad4100e: start","job_status":"start","queue_duration_s":1.749157,"scheduling_latency_s":1.749191}1300vm-test-run-nixbot-gitlab> gitlab # [  262.309294] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"queue_namespace":"container_repository","class":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker","args":[],"jid":"b4d67fcbfd6f9d987ad4100e","created_at":"2026-08-20T05:50:33.179Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-eecfe5caff014b09","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ContainerExpirationPolicyWorker","correlation_id":"b4a64f742d5dfb818ae0debe4fad7bb0","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.220Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerExpirationPolicies::CleanupContainerRepositoryWorker JID-b4d67fcbfd6f9d987ad4100e: done: 0.039395 sec","job_status":"done","queue_duration_s":1.749157,"scheduling_latency_s":1.749191,"redis_calls":10,"redis_duration_s":0.003117,"redis_read_bytes":8,"redis_write_bytes":1310,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001234,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":449,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001883,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":861,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039395,"completed_at":"2026-08-20T05:50:35.008Z","load_balancing_strategy":"primary","db_duration_s":0.005485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301vm-test-run-nixbot-gitlab> gitlab # [  262.348656] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.010Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"77b535239d055d709fad53d2","created_at":"2026-08-20T05:50:33.250Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"495976e1487585ad6bf5f5f89be99c2b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.270Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-77b535239d055d709fad53d2: start","job_status":"start","queue_duration_s":1.74056,"scheduling_latency_s":1.740589}1302vm-test-run-nixbot-gitlab> gitlab # [  262.362978] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.025Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1303vm-test-run-nixbot-gitlab> gitlab # [  262.366347] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"77b535239d055d709fad53d2","created_at":"2026-08-20T05:50:33.250Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"495976e1487585ad6bf5f5f89be99c2b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.270Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-77b535239d055d709fad53d2: done: 0.023193 sec","job_status":"done","queue_duration_s":1.74056,"scheduling_latency_s":1.740589,"redis_calls":10,"redis_duration_s":0.002619,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000596,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001497,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000526,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033368,"duration_s":0.023193,"completed_at":"2026-08-20T05:50:35.033Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000723,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1304vm-test-run-nixbot-gitlab> gitlab # [  262.408610] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.035Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"42fe4f576409951de46ce5dd","created_at":"2026-08-20T05:50:33.342Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75bfa181ca68985d325c4a35b9b81629","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.361Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-42fe4f576409951de46ce5dd: start","job_status":"start","queue_duration_s":1.674028,"scheduling_latency_s":1.674048}1305vm-test-run-nixbot-gitlab> gitlab # [  262.422531] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.294Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"42fe4f576409951de46ce5dd","created_at":"2026-08-20T05:50:33.342Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75bfa181ca68985d325c4a35b9b81629","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.361Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-42fe4f576409951de46ce5dd: done: 0.259288 sec","job_status":"done","queue_duration_s":1.674028,"scheduling_latency_s":1.674048,"redis_calls":14,"redis_duration_s":0.002725,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000764,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001008,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.061,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.178904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00064772,"exclusive_lock_hold_duration_s":0.23040518000000001,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.259288,"completed_at":"2026-08-20T05:50:35.294Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.086919,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1306vm-test-run-nixbot-gitlab> gitlab # [  262.467018] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"380cecea116230978d26dc7a","created_at":"2026-08-20T05:50:33.400Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21cfced2f2ebade0f0f691b800c603a8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.434Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-380cecea116230978d26dc7a: start","job_status":"start","queue_duration_s":1.862569,"scheduling_latency_s":1.862592}1307vm-test-run-nixbot-gitlab> gitlab # [  262.482113] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.326Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"380cecea116230978d26dc7a","created_at":"2026-08-20T05:50:33.400Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"21cfced2f2ebade0f0f691b800c603a8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.434Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-380cecea116230978d26dc7a: done: 0.029416 sec","job_status":"done","queue_duration_s":1.862569,"scheduling_latency_s":1.862592,"redis_calls":10,"redis_duration_s":0.0019030000000000002,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000393,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000423,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026108,"duration_s":0.029416,"completed_at":"2026-08-20T05:50:35.325Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1308vm-test-run-nixbot-gitlab> gitlab # [  262.524154] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.327Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c7aab38d6b14c4f366bf3fac","created_at":"2026-08-20T05:50:33.423Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-940e1e29b5744ad8","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c08642ee504feeb5998affb966254ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.481Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c7aab38d6b14c4f366bf3fac: start","job_status":"start","queue_duration_s":1.846083,"scheduling_latency_s":1.846106}1309vm-test-run-nixbot-gitlab> gitlab # [  262.536306] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.347Z","message":"No existing merge request to be cleaned up."}1310vm-test-run-nixbot-gitlab> gitlab # [  262.537930] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.362Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c7aab38d6b14c4f366bf3fac","created_at":"2026-08-20T05:50:33.423Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-940e1e29b5744ad8","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c08642ee504feeb5998affb966254ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.481Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c7aab38d6b14c4f366bf3fac: done: 0.034622 sec","job_status":"done","queue_duration_s":1.846083,"scheduling_latency_s":1.846106,"redis_calls":13,"redis_duration_s":0.002501,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000413,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00022934,"duration_s":0.034622,"completed_at":"2026-08-20T05:50:35.362Z","load_balancing_strategy":"primary","db_duration_s":0.006341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311vm-test-run-nixbot-gitlab> gitlab # [  262.577980] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.363Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6fc207744878c1f5aad4a925","created_at":"2026-08-20T05:50:33.423Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-940e1e29b5744ad8","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c08642ee504feeb5998affb966254ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.481Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6fc207744878c1f5aad4a925: start","job_status":"start","queue_duration_s":1.882284,"scheduling_latency_s":1.882304}1312vm-test-run-nixbot-gitlab> gitlab # [  262.590030] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.376Z","message":"No existing merge request to be cleaned up."}1313vm-test-run-nixbot-gitlab> gitlab # [  262.591667] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.385Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6fc207744878c1f5aad4a925","created_at":"2026-08-20T05:50:33.423Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-940e1e29b5744ad8","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c08642ee504feeb5998affb966254ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.481Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6fc207744878c1f5aad4a925: done: 0.021162 sec","job_status":"done","queue_duration_s":1.882284,"scheduling_latency_s":1.882304,"redis_calls":10,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000586,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000846,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021162,"completed_at":"2026-08-20T05:50:35.385Z","load_balancing_strategy":"primary","db_duration_s":0.002394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1314vm-test-run-nixbot-gitlab> gitlab # [  262.630533] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.386Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"883952be198abbf9bb47209c","created_at":"2026-08-20T05:50:33.423Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-940e1e29b5744ad8","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c08642ee504feeb5998affb966254ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.481Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-883952be198abbf9bb47209c: start","job_status":"start","queue_duration_s":1.904759,"scheduling_latency_s":1.904779}1315vm-test-run-nixbot-gitlab> gitlab # [  262.643487] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.398Z","message":"No existing merge request to be cleaned up."}1316vm-test-run-nixbot-gitlab> gitlab # [  262.645224] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.407Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"883952be198abbf9bb47209c","created_at":"2026-08-20T05:50:33.423Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-940e1e29b5744ad8","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c08642ee504feeb5998affb966254ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.481Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-883952be198abbf9bb47209c: done: 0.020751 sec","job_status":"done","queue_duration_s":1.904759,"scheduling_latency_s":1.904779,"redis_calls":10,"redis_duration_s":0.001472,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020751,"completed_at":"2026-08-20T05:50:35.407Z","load_balancing_strategy":"primary","db_duration_s":0.002289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317vm-test-run-nixbot-gitlab> gitlab # [  262.684933] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.408Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"906a9b09ccd54da62435ab95","created_at":"2026-08-20T05:50:33.423Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-940e1e29b5744ad8","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c08642ee504feeb5998affb966254ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.481Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-906a9b09ccd54da62435ab95: start","job_status":"start","queue_duration_s":1.92711,"scheduling_latency_s":1.927132}1318vm-test-run-nixbot-gitlab> gitlab # [  262.697102] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.420Z","message":"No existing merge request to be cleaned up."}1319vm-test-run-nixbot-gitlab> gitlab # [  262.698724] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.429Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"906a9b09ccd54da62435ab95","created_at":"2026-08-20T05:50:33.423Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-940e1e29b5744ad8","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8c08642ee504feeb5998affb966254ad","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.481Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-906a9b09ccd54da62435ab95: done: 0.020785 sec","job_status":"done","queue_duration_s":1.92711,"scheduling_latency_s":1.927132,"redis_calls":10,"redis_duration_s":0.001474,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000627,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000847,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020785,"completed_at":"2026-08-20T05:50:35.429Z","load_balancing_strategy":"primary","db_duration_s":0.002546,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1320vm-test-run-nixbot-gitlab> gitlab # [  262.737009] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.431Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"d2cd127b12bdcd5adfa117a6","created_at":"2026-08-20T05:50:33.468Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5a6bdf009378f8a3f91eca8cba099d7","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.493Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-d2cd127b12bdcd5adfa117a6: start","job_status":"start","queue_duration_s":1.937572,"scheduling_latency_s":1.937593}1321vm-test-run-nixbot-gitlab> gitlab # [  262.750392] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.484Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"d2cd127b12bdcd5adfa117a6","created_at":"2026-08-20T05:50:33.468Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5a6bdf009378f8a3f91eca8cba099d7","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.493Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-d2cd127b12bdcd5adfa117a6: done: 0.053479 sec","job_status":"done","queue_duration_s":1.937572,"scheduling_latency_s":1.937593,"redis_calls":10,"redis_duration_s":0.001578,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000327,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000333,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023448,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.0026623},"duration_s":0.053479,"completed_at":"2026-08-20T05:50:35.484Z","load_balancing_strategy":"primary","db_duration_s":0.022337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322vm-test-run-nixbot-gitlab> gitlab # [  262.793134] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.485Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a5aa33b95c8af09d1e997544","created_at":"2026-08-20T05:50:33.517Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59ace66d3a122c6c4b33736a783a7530","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.537Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a5aa33b95c8af09d1e997544: start","job_status":"start","queue_duration_s":1.948485,"scheduling_latency_s":1.948504}1323vm-test-run-nixbot-gitlab> gitlab # [  262.807533] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.615Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"a5aa33b95c8af09d1e997544","created_at":"2026-08-20T05:50:33.517Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59ace66d3a122c6c4b33736a783a7530","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.537Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-a5aa33b95c8af09d1e997544: done: 0.130001 sec","job_status":"done","queue_duration_s":1.948485,"scheduling_latency_s":1.948504,"redis_calls":12,"redis_duration_s":0.002791,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000316,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001335,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00114,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.075,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.075,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005991,"exclusive_lock_hold_duration_s":0.08273056000000001,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.130001,"completed_at":"2026-08-20T05:50:35.615Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.076255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1324vm-test-run-nixbot-gitlab> gitlab # [  262.852442] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.620Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"f215de56e88cf489c4b34d48","created_at":"2026-08-20T05:50:33.552Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9572ddefdbef4927dda7eed392b51f9","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.565Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-f215de56e88cf489c4b34d48: start","job_status":"start","queue_duration_s":2.055534,"scheduling_latency_s":2.055578}1325vm-test-run-nixbot-gitlab> gitlab # [  262.961641] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::PublishEventWorker","jid":"f215de56e88cf489c4b34d48","created_at":"2026-08-20T05:50:33.552Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9572ddefdbef4927dda7eed392b51f9","meta.root_caller_id":"Cronjob","meta.feature_category":"release_orchestration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9f5dbd6b3e0f8a09b95f6e4bc38c93c1137695f37704af6aead7c9933a73fb55","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:33.565Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::PublishEventWorker JID-f215de56e88cf489c4b34d48: done: 0.2384 sec","job_status":"done","queue_duration_s":2.055534,"scheduling_latency_s":2.055578,"redis_calls":10,"redis_duration_s":0.015397,"redis_read_bytes":9,"redis_write_bytes":1039,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001832,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011874,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001691,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.077,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.077,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00476678,"duration_s":0.2384,"completed_at":"2026-08-20T05:50:35.859Z","load_balancing_strategy":"primary","db_duration_s":0.121451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1326vm-test-run-nixbot-gitlab> gitlab # [  263.043908] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:35.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9af540f1bbf3c3d9f58dfba","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9af540f1bbf3c3d9f58dfba: start","job_status":"start","queue_duration_s":1.422351,"scheduling_latency_s":1.422406}1327vm-test-run-nixbot-gitlab> gitlab # [  263.124629] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9af540f1bbf3c3d9f58dfba","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9af540f1bbf3c3d9f58dfba: done: 0.157085 sec","job_status":"done","queue_duration_s":1.422351,"scheduling_latency_s":1.422406,"redis_calls":16,"redis_duration_s":0.009066000000000001,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000745,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006772,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00058478,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.157085,"completed_at":"2026-08-20T05:50:36.023Z","load_balancing_strategy":"primary","db_duration_s":0.006111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1328vm-test-run-nixbot-gitlab> gitlab # [  263.215986] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"950d537db5c49edcef78dbb7","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-950d537db5c49edcef78dbb7: start","job_status":"start","queue_duration_s":1.587702,"scheduling_latency_s":1.587733}1329vm-test-run-nixbot-gitlab> gitlab # [  263.236951] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.082Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"950d537db5c49edcef78dbb7","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-950d537db5c49edcef78dbb7: done: 0.05095 sec","job_status":"done","queue_duration_s":1.587702,"scheduling_latency_s":1.587733,"redis_calls":13,"redis_duration_s":0.005520000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002024,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003496,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.05095,"completed_at":"2026-08-20T05:50:36.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1330vm-test-run-nixbot-gitlab> gitlab # [  263.284391] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"304d3df30222fbd9375aaa6b","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-304d3df30222fbd9375aaa6b: start","job_status":"start","queue_duration_s":1.643572,"scheduling_latency_s":1.64364}1331vm-test-run-nixbot-gitlab> gitlab # [  263.340147] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"304d3df30222fbd9375aaa6b","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-304d3df30222fbd9375aaa6b: done: 0.149968 sec","job_status":"done","queue_duration_s":1.643572,"scheduling_latency_s":1.64364,"redis_calls":13,"redis_duration_s":0.010225,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003309,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.006916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.149968,"completed_at":"2026-08-20T05:50:36.237Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1332vm-test-run-nixbot-gitlab> gitlab # [  263.386446] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62ecb1ee7b3243b1d9401c41","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62ecb1ee7b3243b1d9401c41: start","job_status":"start","queue_duration_s":1.806302,"scheduling_latency_s":1.806347}1333vm-test-run-nixbot-gitlab> gitlab # [  263.462681] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.358Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62ecb1ee7b3243b1d9401c41","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62ecb1ee7b3243b1d9401c41: done: 0.108873 sec","job_status":"done","queue_duration_s":1.806302,"scheduling_latency_s":1.806347,"redis_calls":13,"redis_duration_s":0.021168,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.014569,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.108873,"completed_at":"2026-08-20T05:50:36.358Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1334vm-test-run-nixbot-gitlab> gitlab # [  263.525657] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39e5caad7a7e2daf490a8edf","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39e5caad7a7e2daf490a8edf: start","job_status":"start","queue_duration_s":1.92812,"scheduling_latency_s":1.928167}1335vm-test-run-nixbot-gitlab> gitlab # [  263.584903] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39e5caad7a7e2daf490a8edf","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39e5caad7a7e2daf490a8edf: done: 0.11046 sec","job_status":"done","queue_duration_s":1.92812,"scheduling_latency_s":1.928167,"redis_calls":13,"redis_duration_s":0.019519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.013661,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.11046,"completed_at":"2026-08-20T05:50:36.482Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336vm-test-run-nixbot-gitlab> gitlab # [  263.650001] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.497Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63b99ac51e8e048fc9f3b124","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63b99ac51e8e048fc9f3b124: start","job_status":"start","queue_duration_s":2.053657,"scheduling_latency_s":2.053704}1337vm-test-run-nixbot-gitlab> gitlab # [  263.715159] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63b99ac51e8e048fc9f3b124","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63b99ac51e8e048fc9f3b124: done: 0.115949 sec","job_status":"done","queue_duration_s":2.053657,"scheduling_latency_s":2.053704,"redis_calls":13,"redis_duration_s":0.040942,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.014724,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.026218,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.115949,"completed_at":"2026-08-20T05:50:36.613Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338vm-test-run-nixbot-gitlab> gitlab # [  263.789709] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ac4276d5511895e9d9578f2","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ac4276d5511895e9d9578f2: start","job_status":"start","queue_duration_s":2.180739,"scheduling_latency_s":2.180784}1339vm-test-run-nixbot-gitlab> gitlab # [  263.820827] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ac4276d5511895e9d9578f2","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ac4276d5511895e9d9578f2: done: 0.09395 sec","job_status":"done","queue_duration_s":2.180739,"scheduling_latency_s":2.180784,"redis_calls":13,"redis_duration_s":0.037252,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.011873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.025379,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.09395,"completed_at":"2026-08-20T05:50:36.718Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340vm-test-run-nixbot-gitlab> gitlab # [  263.885036] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc9da6c973cc6220d301e543","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc9da6c973cc6220d301e543: start","job_status":"start","queue_duration_s":2.289578,"scheduling_latency_s":2.289623}1341vm-test-run-nixbot-gitlab> gitlab # [  263.963144] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc9da6c973cc6220d301e543","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc9da6c973cc6220d301e543: done: 0.128029 sec","job_status":"done","queue_duration_s":2.289578,"scheduling_latency_s":2.289623,"redis_calls":13,"redis_duration_s":0.036331,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.009758,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.026573,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.128029,"completed_at":"2026-08-20T05:50:36.861Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342vm-test-run-nixbot-gitlab> gitlab # [  264.044764] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:36.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ab1ad24acbdb61e0e857375","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ab1ad24acbdb61e0e857375: start","job_status":"start","queue_duration_s":2.420613,"scheduling_latency_s":2.420658}1343vm-test-run-nixbot-gitlab> gitlab # [  264.194083] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:37.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ab1ad24acbdb61e0e857375","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ab1ad24acbdb61e0e857375: done: 0.22785 sec","job_status":"done","queue_duration_s":2.420613,"scheduling_latency_s":2.420658,"redis_calls":13,"redis_duration_s":0.004026,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001324,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002702,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.22785,"completed_at":"2026-08-20T05:50:37.092Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344vm-test-run-nixbot-gitlab> gitlab # [  264.291746] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:37.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a8749fb273041ebcdd33bf4","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a8749fb273041ebcdd33bf4: start","job_status":"start","queue_duration_s":2.65622,"scheduling_latency_s":2.656255}1345vm-test-run-nixbot-gitlab> gitlab # [  264.369001] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:37.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a8749fb273041ebcdd33bf4","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a8749fb273041ebcdd33bf4: done: 0.166236 sec","job_status":"done","queue_duration_s":2.65622,"scheduling_latency_s":2.656255,"redis_calls":13,"redis_duration_s":0.055756,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005445,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.050311,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.166236,"completed_at":"2026-08-20T05:50:37.266Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346vm-test-run-nixbot-gitlab> gitlab # [  264.428740] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:37.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36889dac29a060bf41bc84df","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36889dac29a060bf41bc84df: start","job_status":"start","queue_duration_s":2.829958,"scheduling_latency_s":2.829997}1347vm-test-run-nixbot-gitlab> gitlab # [  264.483154] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:37.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36889dac29a060bf41bc84df","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36889dac29a060bf41bc84df: done: 0.107721 sec","job_status":"done","queue_duration_s":2.829958,"scheduling_latency_s":2.829997,"redis_calls":13,"redis_duration_s":0.064301,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.007132,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.057169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.107721,"completed_at":"2026-08-20T05:50:37.381Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348vm-test-run-nixbot-gitlab> gitlab # [  264.562734] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:37.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e8894bcafbd70e86964ed53","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e8894bcafbd70e86964ed53: start","job_status":"start","queue_duration_s":3.017471,"scheduling_latency_s":3.01753}1349vm-test-run-nixbot-gitlab> gitlab # [  264.686548] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:37.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e8894bcafbd70e86964ed53","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e8894bcafbd70e86964ed53: done: 0.12118 sec","job_status":"done","queue_duration_s":3.017471,"scheduling_latency_s":3.01753,"redis_calls":13,"redis_duration_s":0.019515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006396,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.013119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.12118,"completed_at":"2026-08-20T05:50:37.582Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1350vm-test-run-nixbot-gitlab> gitlab # [  264.787215] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:37.685Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"044dc9086a98256ebcae3a7c","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-044dc9086a98256ebcae3a7c: start","job_status":"start","queue_duration_s":3.241896,"scheduling_latency_s":3.241958}1351vm-test-run-nixbot-gitlab> gitlab # [  264.944186] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:37.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"044dc9086a98256ebcae3a7c","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-044dc9086a98256ebcae3a7c: done: 0.154796 sec","job_status":"done","queue_duration_s":3.241896,"scheduling_latency_s":3.241958,"redis_calls":13,"redis_duration_s":0.026806999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.010715,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.016092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.154796,"completed_at":"2026-08-20T05:50:37.840Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352vm-test-run-nixbot-gitlab> gitlab # [  265.010299] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:37.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"920c22539cb313e61b138fa1","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-920c22539cb313e61b138fa1: start","job_status":"start","queue_duration_s":3.465058,"scheduling_latency_s":3.465121}1353vm-test-run-nixbot-gitlab> gitlab # [  265.154659] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"920c22539cb313e61b138fa1","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-920c22539cb313e61b138fa1: done: 0.142672 sec","job_status":"done","queue_duration_s":3.465058,"scheduling_latency_s":3.465121,"redis_calls":13,"redis_duration_s":0.025291,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.017238,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.142672,"completed_at":"2026-08-20T05:50:38.051Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354vm-test-run-nixbot-gitlab> gitlab # [  265.237964] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.136Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"814ca6ba2421e284e83361ff","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-814ca6ba2421e284e83361ff: start","job_status":"start","queue_duration_s":3.692371,"scheduling_latency_s":3.692432}1355vm-test-run-nixbot-gitlab> gitlab # [  265.302920] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"814ca6ba2421e284e83361ff","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-814ca6ba2421e284e83361ff: done: 0.064222 sec","job_status":"done","queue_duration_s":3.692371,"scheduling_latency_s":3.692432,"redis_calls":13,"redis_duration_s":0.020922,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00761,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.013312,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.064222,"completed_at":"2026-08-20T05:50:38.200Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1356vm-test-run-nixbot-gitlab> gitlab # [  265.380725] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de16f05c131cdcda1a76c47b","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de16f05c131cdcda1a76c47b: start","job_status":"start","queue_duration_s":3.835263,"scheduling_latency_s":3.835326}1357vm-test-run-nixbot-gitlab> gitlab # [  265.455582] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de16f05c131cdcda1a76c47b","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de16f05c131cdcda1a76c47b: done: 0.075236 sec","job_status":"done","queue_duration_s":3.835263,"scheduling_latency_s":3.835326,"redis_calls":13,"redis_duration_s":0.024383000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.015429,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.075236,"completed_at":"2026-08-20T05:50:38.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1358vm-test-run-nixbot-gitlab> gitlab # [  265.542429] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f0f64d12de004760c7fc0e2","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f0f64d12de004760c7fc0e2: start","job_status":"start","queue_duration_s":3.923119,"scheduling_latency_s":3.923162}1359vm-test-run-nixbot-gitlab> gitlab # [  265.559424] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f0f64d12de004760c7fc0e2","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f0f64d12de004760c7fc0e2: done: 0.060371 sec","job_status":"done","queue_duration_s":3.923119,"scheduling_latency_s":3.923162,"redis_calls":13,"redis_duration_s":0.021179,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00852,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.012659,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.060371,"completed_at":"2026-08-20T05:50:38.427Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360vm-test-run-nixbot-gitlab> gitlab # [  265.607233] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a92b7e3bb2c36e8b841858bb","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a92b7e3bb2c36e8b841858bb: start","job_status":"start","queue_duration_s":3.99273,"scheduling_latency_s":3.992771}1361vm-test-run-nixbot-gitlab> gitlab # [  265.676187] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a92b7e3bb2c36e8b841858bb","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a92b7e3bb2c36e8b841858bb: done: 0.137864 sec","job_status":"done","queue_duration_s":3.99273,"scheduling_latency_s":3.992771,"redis_calls":13,"redis_duration_s":0.026514,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.008988,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.017526,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.137864,"completed_at":"2026-08-20T05:50:38.574Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1362vm-test-run-nixbot-gitlab> gitlab # [  265.740728] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af0249daf8c43d035446766e","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af0249daf8c43d035446766e: start","job_status":"start","queue_duration_s":4.144216,"scheduling_latency_s":4.144277}1363vm-test-run-nixbot-gitlab> gitlab # [  265.883917] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af0249daf8c43d035446766e","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af0249daf8c43d035446766e: done: 0.193969 sec","job_status":"done","queue_duration_s":4.144216,"scheduling_latency_s":4.144277,"redis_calls":13,"redis_duration_s":0.017008,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005838,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.01117,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.193969,"completed_at":"2026-08-20T05:50:38.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364vm-test-run-nixbot-gitlab> gitlab # [  265.956926] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e5f97e2bf0f60fc16c15ed1","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e5f97e2bf0f60fc16c15ed1: start","job_status":"start","queue_duration_s":4.346508,"scheduling_latency_s":4.346562}1365vm-test-run-nixbot-gitlab> gitlab # [  265.971472] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.845Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e5f97e2bf0f60fc16c15ed1","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e5f97e2bf0f60fc16c15ed1: done: 0.055541 sec","job_status":"done","queue_duration_s":4.346508,"scheduling_latency_s":4.346562,"redis_calls":13,"redis_duration_s":0.004071,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001424,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002647,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.055541,"completed_at":"2026-08-20T05:50:38.845Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1366vm-test-run-nixbot-gitlab> gitlab # [  266.015841] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d772a0874cd56bb8e3157ae8","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d772a0874cd56bb8e3157ae8: start","job_status":"start","queue_duration_s":4.408684,"scheduling_latency_s":4.408744}1367vm-test-run-nixbot-gitlab> gitlab # [  266.029416] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d772a0874cd56bb8e3157ae8","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d772a0874cd56bb8e3157ae8: done: 0.062982 sec","job_status":"done","queue_duration_s":4.408684,"scheduling_latency_s":4.408744,"redis_calls":13,"redis_duration_s":0.006753,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001699,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.062982,"completed_at":"2026-08-20T05:50:38.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368vm-test-run-nixbot-gitlab> gitlab # [  266.068296] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ed93b5eaf98756fdcbc8992","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ed93b5eaf98756fdcbc8992: start","job_status":"start","queue_duration_s":4.476082,"scheduling_latency_s":4.476131}1369vm-test-run-nixbot-gitlab> gitlab # [  266.080437] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ed93b5eaf98756fdcbc8992","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ed93b5eaf98756fdcbc8992: done: 0.052371 sec","job_status":"done","queue_duration_s":4.476082,"scheduling_latency_s":4.476131,"redis_calls":13,"redis_duration_s":0.004178,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001152,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003026,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022932,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.052371,"completed_at":"2026-08-20T05:50:38.972Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370vm-test-run-nixbot-gitlab> gitlab # [  266.120096] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:38.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6129243d8f7ce0878086a1cf","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6129243d8f7ce0878086a1cf: start","job_status":"start","queue_duration_s":4.53435,"scheduling_latency_s":4.534399}1371vm-test-run-nixbot-gitlab> gitlab # [  266.149283] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6129243d8f7ce0878086a1cf","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6129243d8f7ce0878086a1cf: done: 0.069926 sec","job_status":"done","queue_duration_s":4.53435,"scheduling_latency_s":4.534399,"redis_calls":13,"redis_duration_s":0.003458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001197,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002261,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.069926,"completed_at":"2026-08-20T05:50:39.047Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372vm-test-run-nixbot-gitlab> gitlab # [  266.189926] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"249cb0bef53ab02d6555baf5","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-249cb0bef53ab02d6555baf5: start","job_status":"start","queue_duration_s":4.610367,"scheduling_latency_s":4.610412}1373vm-test-run-nixbot-gitlab> gitlab # [  266.250751] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.149Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"249cb0bef53ab02d6555baf5","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-249cb0bef53ab02d6555baf5: done: 0.095326 sec","job_status":"done","queue_duration_s":4.610367,"scheduling_latency_s":4.610412,"redis_calls":13,"redis_duration_s":0.016064000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.005165,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.095326,"completed_at":"2026-08-20T05:50:39.149Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374vm-test-run-nixbot-gitlab> gitlab # [  266.297851] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20a7e218827a82e6fa0d9fd8","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20a7e218827a82e6fa0d9fd8: start","job_status":"start","queue_duration_s":4.71689,"scheduling_latency_s":4.716954}1375vm-test-run-nixbot-gitlab> gitlab # [  266.377536] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"20a7e218827a82e6fa0d9fd8","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-20a7e218827a82e6fa0d9fd8: done: 0.114023 sec","job_status":"done","queue_duration_s":4.71689,"scheduling_latency_s":4.716954,"redis_calls":13,"redis_duration_s":0.008334999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004319,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030854,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.114023,"completed_at":"2026-08-20T05:50:39.274Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376vm-test-run-nixbot-gitlab> gitlab # [  266.431738] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e5fd3ac5b6aade7fbabb7df","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e5fd3ac5b6aade7fbabb7df: start","job_status":"start","queue_duration_s":4.842669,"scheduling_latency_s":4.842713}1377vm-test-run-nixbot-gitlab> gitlab # [  266.448416] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e5fd3ac5b6aade7fbabb7df","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e5fd3ac5b6aade7fbabb7df: done: 0.060464 sec","job_status":"done","queue_duration_s":4.842669,"scheduling_latency_s":4.842713,"redis_calls":13,"redis_duration_s":0.004119,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001422,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002697,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.060464,"completed_at":"2026-08-20T05:50:39.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378vm-test-run-nixbot-gitlab> gitlab # [  266.487200] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cb88c4789ff9fb3a635cb80","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cb88c4789ff9fb3a635cb80: start","job_status":"start","queue_duration_s":4.905549,"scheduling_latency_s":4.905592}1379vm-test-run-nixbot-gitlab> gitlab # [  266.499680] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.374Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2cb88c4789ff9fb3a635cb80","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2cb88c4789ff9fb3a635cb80: done: 0.024876 sec","job_status":"done","queue_duration_s":4.905549,"scheduling_latency_s":4.905592,"redis_calls":13,"redis_duration_s":0.003116,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024876,"completed_at":"2026-08-20T05:50:39.374Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1380vm-test-run-nixbot-gitlab> gitlab # [  266.538974] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.376Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8732dd43dec039c041098b6","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8732dd43dec039c041098b6: start","job_status":"start","queue_duration_s":4.932333,"scheduling_latency_s":4.932364}1381vm-test-run-nixbot-gitlab> gitlab # [  266.551534] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8732dd43dec039c041098b6","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8732dd43dec039c041098b6: done: 0.020299 sec","job_status":"done","queue_duration_s":4.932333,"scheduling_latency_s":4.932364,"redis_calls":13,"redis_duration_s":0.002974,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001061,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020299,"completed_at":"2026-08-20T05:50:39.396Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1382vm-test-run-nixbot-gitlab> gitlab # [  266.590902] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c4650280ca13901f4b13a09","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c4650280ca13901f4b13a09: start","job_status":"start","queue_duration_s":4.95528,"scheduling_latency_s":4.955311}1383vm-test-run-nixbot-gitlab> gitlab # [  266.604509] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8c4650280ca13901f4b13a09","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8c4650280ca13901f4b13a09: done: 0.017892 sec","job_status":"done","queue_duration_s":4.95528,"scheduling_latency_s":4.955311,"redis_calls":13,"redis_duration_s":0.002703,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017892,"completed_at":"2026-08-20T05:50:39.416Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1384vm-test-run-nixbot-gitlab> gitlab # [  266.643578] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df6d58395ff28e94511b2629","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df6d58395ff28e94511b2629: start","job_status":"start","queue_duration_s":4.974794,"scheduling_latency_s":4.97482}1385vm-test-run-nixbot-gitlab> gitlab # [  266.656167] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df6d58395ff28e94511b2629","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df6d58395ff28e94511b2629: done: 0.0176 sec","job_status":"done","queue_duration_s":4.974794,"scheduling_latency_s":4.97482,"redis_calls":13,"redis_duration_s":0.002671,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000893,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001778,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0176,"completed_at":"2026-08-20T05:50:39.436Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386vm-test-run-nixbot-gitlab> gitlab # [  266.695198] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2719f3a95aed5773d5606355","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2719f3a95aed5773d5606355: start","job_status":"start","queue_duration_s":4.993982,"scheduling_latency_s":4.994008}1387vm-test-run-nixbot-gitlab> gitlab # [  266.707756] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2719f3a95aed5773d5606355","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2719f3a95aed5773d5606355: done: 0.016424 sec","job_status":"done","queue_duration_s":4.993982,"scheduling_latency_s":4.994008,"redis_calls":13,"redis_duration_s":0.002559,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001647,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016424,"completed_at":"2026-08-20T05:50:39.454Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1388vm-test-run-nixbot-gitlab> gitlab # [  266.747004] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d1ef3d70a0f4ff438255a21","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d1ef3d70a0f4ff438255a21: start","job_status":"start","queue_duration_s":5.012588,"scheduling_latency_s":5.012617}1389vm-test-run-nixbot-gitlab> gitlab # [  266.759452] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d1ef3d70a0f4ff438255a21","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d1ef3d70a0f4ff438255a21: done: 0.016062 sec","job_status":"done","queue_duration_s":5.012588,"scheduling_latency_s":5.012617,"redis_calls":13,"redis_duration_s":0.002568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000862,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001706,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016062,"completed_at":"2026-08-20T05:50:39.472Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1390vm-test-run-nixbot-gitlab> gitlab # [  266.799317] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fd7215103fd4992a4678681","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fd7215103fd4992a4678681: start","job_status":"start","queue_duration_s":5.030161,"scheduling_latency_s":5.030188}1391vm-test-run-nixbot-gitlab> gitlab # [  266.811772] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fd7215103fd4992a4678681","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fd7215103fd4992a4678681: done: 0.015833 sec","job_status":"done","queue_duration_s":5.030161,"scheduling_latency_s":5.030188,"redis_calls":13,"redis_duration_s":0.002582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009796,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015833,"completed_at":"2026-08-20T05:50:39.489Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392vm-test-run-nixbot-gitlab> gitlab # [  266.850912] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0afae8da7ccbc82f604214fd","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0afae8da7ccbc82f604214fd: start","job_status":"start","queue_duration_s":5.047901,"scheduling_latency_s":5.047932}1393vm-test-run-nixbot-gitlab> gitlab # [  266.863121] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0afae8da7ccbc82f604214fd","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0afae8da7ccbc82f604214fd: done: 0.017749 sec","job_status":"done","queue_duration_s":5.047901,"scheduling_latency_s":5.047932,"redis_calls":13,"redis_duration_s":0.0031539999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001349,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001805,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00983,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017749,"completed_at":"2026-08-20T05:50:39.509Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394vm-test-run-nixbot-gitlab> gitlab # [  266.902555] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71f60632c0db922c0c963ce5","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71f60632c0db922c0c963ce5: start","job_status":"start","queue_duration_s":5.067248,"scheduling_latency_s":5.067273}1395vm-test-run-nixbot-gitlab> gitlab # [  266.915009] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71f60632c0db922c0c963ce5","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71f60632c0db922c0c963ce5: done: 0.015236 sec","job_status":"done","queue_duration_s":5.067248,"scheduling_latency_s":5.067273,"redis_calls":13,"redis_duration_s":0.0026030000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001737,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015236,"completed_at":"2026-08-20T05:50:39.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396vm-test-run-nixbot-gitlab> gitlab # [  266.954343] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72c0eadc59e5adec9a3c356f","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72c0eadc59e5adec9a3c356f: start","job_status":"start","queue_duration_s":5.083838,"scheduling_latency_s":5.083855}1397vm-test-run-nixbot-gitlab> gitlab # [  266.966804] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"72c0eadc59e5adec9a3c356f","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-72c0eadc59e5adec9a3c356f: done: 0.014753 sec","job_status":"done","queue_duration_s":5.083838,"scheduling_latency_s":5.083855,"redis_calls":13,"redis_duration_s":0.0024230000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001587,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014753,"completed_at":"2026-08-20T05:50:39.542Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398vm-test-run-nixbot-gitlab> gitlab # [  267.007175] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8471786677a5ea2d6a66ea03","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8471786677a5ea2d6a66ea03: start","job_status":"start","queue_duration_s":5.09988,"scheduling_latency_s":5.099898}1399vm-test-run-nixbot-gitlab> gitlab # [  267.019854] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8471786677a5ea2d6a66ea03","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8471786677a5ea2d6a66ea03: done: 0.01463 sec","job_status":"done","queue_duration_s":5.09988,"scheduling_latency_s":5.099898,"redis_calls":13,"redis_duration_s":0.002474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000831,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001643,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01463,"completed_at":"2026-08-20T05:50:39.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400vm-test-run-nixbot-gitlab> gitlab # [  267.059342] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c34167747be4db6bd6500759","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c34167747be4db6bd6500759: start","job_status":"start","queue_duration_s":5.115887,"scheduling_latency_s":5.115904}1401vm-test-run-nixbot-gitlab> gitlab # [  267.071873] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c34167747be4db6bd6500759","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c34167747be4db6bd6500759: done: 0.015012 sec","job_status":"done","queue_duration_s":5.115887,"scheduling_latency_s":5.115904,"redis_calls":13,"redis_duration_s":0.002443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001592,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015012,"completed_at":"2026-08-20T05:50:39.574Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402vm-test-run-nixbot-gitlab> gitlab # [  267.111408] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69c9ba0c90f112aee356e598","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69c9ba0c90f112aee356e598: start","job_status":"start","queue_duration_s":5.132321,"scheduling_latency_s":5.132338}1403vm-test-run-nixbot-gitlab> gitlab # [  267.124102] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69c9ba0c90f112aee356e598","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69c9ba0c90f112aee356e598: done: 0.014767 sec","job_status":"done","queue_duration_s":5.132321,"scheduling_latency_s":5.132338,"redis_calls":13,"redis_duration_s":0.002503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001643,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014767,"completed_at":"2026-08-20T05:50:39.590Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404vm-test-run-nixbot-gitlab> gitlab # [  267.163078] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f727c9df5d4e8f518db2f7fc","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f727c9df5d4e8f518db2f7fc: start","job_status":"start","queue_duration_s":5.148448,"scheduling_latency_s":5.148465}1405vm-test-run-nixbot-gitlab> gitlab # [  267.175460] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f727c9df5d4e8f518db2f7fc","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f727c9df5d4e8f518db2f7fc: done: 0.015328 sec","job_status":"done","queue_duration_s":5.148448,"scheduling_latency_s":5.148465,"redis_calls":13,"redis_duration_s":0.002562,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001658,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015328,"completed_at":"2026-08-20T05:50:39.607Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406vm-test-run-nixbot-gitlab> gitlab # [  267.216104] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"896c046e6b1b44fa28ec7617","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-896c046e6b1b44fa28ec7617: start","job_status":"start","queue_duration_s":5.16557,"scheduling_latency_s":5.165585}1407vm-test-run-nixbot-gitlab> gitlab # [  267.228824] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"896c046e6b1b44fa28ec7617","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-896c046e6b1b44fa28ec7617: done: 0.014445 sec","job_status":"done","queue_duration_s":5.16557,"scheduling_latency_s":5.165585,"redis_calls":13,"redis_duration_s":0.002425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000849,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001576,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014445,"completed_at":"2026-08-20T05:50:39.623Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408vm-test-run-nixbot-gitlab> gitlab # [  267.268673] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f0c54d6fd41b380bcda81a3","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f0c54d6fd41b380bcda81a3: start","job_status":"start","queue_duration_s":5.181332,"scheduling_latency_s":5.181348}1409vm-test-run-nixbot-gitlab> gitlab # [  267.281275] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f0c54d6fd41b380bcda81a3","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f0c54d6fd41b380bcda81a3: done: 0.014551 sec","job_status":"done","queue_duration_s":5.181332,"scheduling_latency_s":5.181348,"redis_calls":13,"redis_duration_s":0.002475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000834,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001641,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014551,"completed_at":"2026-08-20T05:50:39.639Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410vm-test-run-nixbot-gitlab> gitlab # [  267.320491] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c762bc24b101afdcb1c46d","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c762bc24b101afdcb1c46d: start","job_status":"start","queue_duration_s":5.197199,"scheduling_latency_s":5.197214}1411vm-test-run-nixbot-gitlab> gitlab # [  267.332938] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c762bc24b101afdcb1c46d","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c762bc24b101afdcb1c46d: done: 0.014403 sec","job_status":"done","queue_duration_s":5.197199,"scheduling_latency_s":5.197214,"redis_calls":13,"redis_duration_s":0.002464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000841,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001623,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014403,"completed_at":"2026-08-20T05:50:39.655Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412vm-test-run-nixbot-gitlab> gitlab # [  267.374252] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a115b22adac49abf44dd6926","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a115b22adac49abf44dd6926: start","job_status":"start","queue_duration_s":5.213492,"scheduling_latency_s":5.21351}1413vm-test-run-nixbot-gitlab> gitlab # [  267.387531] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a115b22adac49abf44dd6926","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a115b22adac49abf44dd6926: done: 0.016058 sec","job_status":"done","queue_duration_s":5.213492,"scheduling_latency_s":5.21351,"redis_calls":13,"redis_duration_s":0.002515,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000873,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001642,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016058,"completed_at":"2026-08-20T05:50:39.672Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414vm-test-run-nixbot-gitlab> gitlab # [  267.428708] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f28735c7f358b2b84e09108","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f28735c7f358b2b84e09108: start","job_status":"start","queue_duration_s":5.230468,"scheduling_latency_s":5.230485}1415vm-test-run-nixbot-gitlab> gitlab # [  267.441357] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f28735c7f358b2b84e09108","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f28735c7f358b2b84e09108: done: 0.016483 sec","job_status":"done","queue_duration_s":5.230468,"scheduling_latency_s":5.230485,"redis_calls":13,"redis_duration_s":0.0027419999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001829,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016483,"completed_at":"2026-08-20T05:50:39.690Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416vm-test-run-nixbot-gitlab> gitlab # [  267.481009] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f3fb5536dfd408d2678d329","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f3fb5536dfd408d2678d329: start","job_status":"start","queue_duration_s":5.248885,"scheduling_latency_s":5.248903}1417vm-test-run-nixbot-gitlab> gitlab # [  267.493503] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f3fb5536dfd408d2678d329","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f3fb5536dfd408d2678d329: done: 0.016426 sec","job_status":"done","queue_duration_s":5.248885,"scheduling_latency_s":5.248903,"redis_calls":13,"redis_duration_s":0.002758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001821,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016426,"completed_at":"2026-08-20T05:50:39.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418vm-test-run-nixbot-gitlab> gitlab # [  267.533003] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30dbea0d782b47ed276ae83b","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30dbea0d782b47ed276ae83b: start","job_status":"start","queue_duration_s":5.267156,"scheduling_latency_s":5.267174}1419vm-test-run-nixbot-gitlab> gitlab # [  267.545190] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30dbea0d782b47ed276ae83b","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30dbea0d782b47ed276ae83b: done: 0.016673 sec","job_status":"done","queue_duration_s":5.267156,"scheduling_latency_s":5.267174,"redis_calls":13,"redis_duration_s":0.0030369999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001363,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001674,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016673,"completed_at":"2026-08-20T05:50:39.727Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420vm-test-run-nixbot-gitlab> gitlab # [  267.584621] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62c467a0896da4c80fb8be98","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62c467a0896da4c80fb8be98: start","job_status":"start","queue_duration_s":5.285922,"scheduling_latency_s":5.28594}1421vm-test-run-nixbot-gitlab> gitlab # [  267.596945] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62c467a0896da4c80fb8be98","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62c467a0896da4c80fb8be98: done: 0.01618 sec","job_status":"done","queue_duration_s":5.285922,"scheduling_latency_s":5.28594,"redis_calls":13,"redis_duration_s":0.0029649999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002113,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01618,"completed_at":"2026-08-20T05:50:39.745Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422vm-test-run-nixbot-gitlab> gitlab # [  267.637125] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30f9b6d728a4b6306798d0b0","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30f9b6d728a4b6306798d0b0: start","job_status":"start","queue_duration_s":5.304435,"scheduling_latency_s":5.304454}1423vm-test-run-nixbot-gitlab> gitlab # [  267.649564] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30f9b6d728a4b6306798d0b0","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30f9b6d728a4b6306798d0b0: done: 0.016014 sec","job_status":"done","queue_duration_s":5.304435,"scheduling_latency_s":5.304454,"redis_calls":13,"redis_duration_s":0.002509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001649,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010587,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016014,"completed_at":"2026-08-20T05:50:39.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424vm-test-run-nixbot-gitlab> gitlab # [  267.688887] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c917d5cdad2e655b615e2478","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c917d5cdad2e655b615e2478: start","job_status":"start","queue_duration_s":5.321774,"scheduling_latency_s":5.32179}1425vm-test-run-nixbot-gitlab> gitlab # [  267.701181] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c917d5cdad2e655b615e2478","created_at":"2026-08-20T05:50:34.359Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-9a5c9d24488a44f5","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"720b0cab9de589c4c14cfbe282c5d3d2","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.443Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c917d5cdad2e655b615e2478: done: 0.016042 sec","job_status":"done","queue_duration_s":5.321774,"scheduling_latency_s":5.32179,"redis_calls":13,"redis_duration_s":0.002654,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001773,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016042,"completed_at":"2026-08-20T05:50:39.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426vm-test-run-nixbot-gitlab> gitlab # [  267.740587] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.782Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"432256f36850d8aab8d92e74","created_at":"2026-08-20T05:50:34.718Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-f374d2ac55ea4d5f","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"3ad458f79b2c14430b271845e3f45df2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.729Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-432256f36850d8aab8d92e74: start","job_status":"start","queue_duration_s":5.053907,"scheduling_latency_s":5.053923}1427vm-test-run-nixbot-gitlab> gitlab # [  267.755549] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.836Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"432256f36850d8aab8d92e74","created_at":"2026-08-20T05:50:34.718Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-f374d2ac55ea4d5f","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"3ad458f79b2c14430b271845e3f45df2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.729Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-432256f36850d8aab8d92e74: done: 0.053502 sec","job_status":"done","queue_duration_s":5.053907,"scheduling_latency_s":5.053923,"redis_calls":10,"redis_duration_s":0.0038759999999999997,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001197,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002067,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000612,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00066928,"duration_s":0.053502,"completed_at":"2026-08-20T05:50:39.836Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009527,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428vm-test-run-nixbot-gitlab> gitlab # [  267.798856] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.839Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"96d9a29aafc046d88ac5358e","created_at":"2026-08-20T05:50:34.729Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-f374d2ac55ea4d5f","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"3ad458f79b2c14430b271845e3f45df2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.735Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-96d9a29aafc046d88ac5358e: start","job_status":"start","queue_duration_s":5.104728,"scheduling_latency_s":5.104771}1429vm-test-run-nixbot-gitlab> gitlab # [  267.814177] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:50:39.882Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"96d9a29aafc046d88ac5358e","created_at":"2026-08-20T05:50:34.729Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-f374d2ac55ea4d5f","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"3ad458f79b2c14430b271845e3f45df2","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-08-20T05:50:34.735Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-96d9a29aafc046d88ac5358e: done: 0.042719 sec","job_status":"done","queue_duration_s":5.104728,"scheduling_latency_s":5.104771,"redis_calls":10,"redis_duration_s":0.0036220000000000002,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000718,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002118,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000786,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009208,"duration_s":0.042719,"completed_at":"2026-08-20T05:50:39.882Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001656,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430vm-test-run-nixbot-gitlab> gitlab # [  291.582372] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:04.478Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9871deab6089887b23cc17bc","created_at":"2026-08-20T05:51:04.451Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0dfa3cb719c7d196954254a0eda03ab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.467Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9871deab6089887b23cc17bc: start","job_status":"start","queue_duration_s":0.010799,"scheduling_latency_s":0.010862}1431vm-test-run-nixbot-gitlab> gitlab # [  291.726853] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:04.624Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9871deab6089887b23cc17bc","created_at":"2026-08-20T05:51:04.451Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0dfa3cb719c7d196954254a0eda03ab","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.467Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9871deab6089887b23cc17bc: done: 0.146989 sec","job_status":"done","queue_duration_s":0.010799,"scheduling_latency_s":0.010862,"redis_calls":7,"redis_duration_s":0.008054,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006372,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001682,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.146989,"completed_at":"2026-08-20T05:51:04.624Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432vm-test-run-nixbot-gitlab> gitlab # [  291.804406] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:04.636Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"c59f14a5a1e1991f3225773b","created_at":"2026-08-20T05:51:04.476Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dca9089b073c93d6e576ad0128f2aca3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:51:04.488Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-c59f14a5a1e1991f3225773b: start","job_status":"start","queue_duration_s":0.147788,"scheduling_latency_s":0.147847}1433vm-test-run-nixbot-gitlab> gitlab # [  291.819888] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:04.699Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1434vm-test-run-nixbot-gitlab> gitlab # [  291.833944] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:04.732Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"c59f14a5a1e1991f3225773b","created_at":"2026-08-20T05:51:04.476Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dca9089b073c93d6e576ad0128f2aca3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:51:04.488Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-c59f14a5a1e1991f3225773b: done: 0.096682 sec","job_status":"done","queue_duration_s":0.147788,"scheduling_latency_s":0.147847,"redis_calls":7,"redis_duration_s":0.028337,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.023889,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004448,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.096682,"completed_at":"2026-08-20T05:51:04.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435vm-test-run-nixbot-gitlab> gitlab # [  291.876474] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:04.744Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"9da1b99a0224564b4270d87c","created_at":"2026-08-20T05:51:04.497Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20ec5777de41d5b4dc6349b208bc0422","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.506Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-9da1b99a0224564b4270d87c: start","job_status":"start","queue_duration_s":0.238364,"scheduling_latency_s":0.238407}1436vm-test-run-nixbot-gitlab> gitlab # [  291.919401] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:04.818Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1437vm-test-run-nixbot-gitlab> gitlab # [  291.960741] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:04.858Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"9da1b99a0224564b4270d87c","created_at":"2026-08-20T05:51:04.497Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20ec5777de41d5b4dc6349b208bc0422","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.506Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-9da1b99a0224564b4270d87c: done: 0.113768 sec","job_status":"done","queue_duration_s":0.238364,"scheduling_latency_s":0.238407,"redis_calls":7,"redis_duration_s":0.05268,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.048888,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003792,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.113768,"completed_at":"2026-08-20T05:51:04.858Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438vm-test-run-nixbot-gitlab> gitlab # [  292.046330] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:04.883Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"280a7f53dc437d4967ca989c","created_at":"2026-08-20T05:51:04.515Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"825bcaf577989516c17ad26e55e3ed9b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.521Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-280a7f53dc437d4967ca989c: start","job_status":"start","queue_duration_s":0.362676,"scheduling_latency_s":0.362736}1439vm-test-run-nixbot-gitlab> gitlab # [  292.192326] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.090Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"280a7f53dc437d4967ca989c","created_at":"2026-08-20T05:51:04.515Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"825bcaf577989516c17ad26e55e3ed9b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.521Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-280a7f53dc437d4967ca989c: done: 0.206497 sec","job_status":"done","queue_duration_s":0.362676,"scheduling_latency_s":0.362736,"redis_calls":9,"redis_duration_s":0.015179,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006609,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00857,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00182364,"exclusive_lock_hold_duration_s":0.04052886,"duration_s":0.206497,"completed_at":"2026-08-20T05:51:05.090Z","load_balancing_strategy":"primary","db_duration_s":0.033979,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440vm-test-run-nixbot-gitlab> gitlab # [  292.281203] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.093Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"883418b07fa8d3e3df004275","created_at":"2026-08-20T05:51:04.546Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"132db6894ad70ff86dd6fe9fdd017a88","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.552Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-883418b07fa8d3e3df004275: start","job_status":"start","queue_duration_s":0.540997,"scheduling_latency_s":0.54105}1441vm-test-run-nixbot-gitlab> gitlab # [  292.298297] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.154Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"883418b07fa8d3e3df004275","created_at":"2026-08-20T05:51:04.546Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"132db6894ad70ff86dd6fe9fdd017a88","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.552Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-883418b07fa8d3e3df004275: done: 0.060672 sec","job_status":"done","queue_duration_s":0.540997,"scheduling_latency_s":0.54105,"redis_calls":14,"redis_duration_s":0.005058,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000601,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003385,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001072,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.060672,"completed_at":"2026-08-20T05:51:05.154Z","load_balancing_strategy":"primary","db_duration_s":0.001458,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442vm-test-run-nixbot-gitlab> gitlab # [  292.344214] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.156Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f3fa9608d7fae004ccb7510b","created_at":"2026-08-20T05:51:04.572Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a9c609006d480b4919bc1190cbbe6e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.577Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f3fa9608d7fae004ccb7510b: start","job_status":"start","queue_duration_s":0.579403,"scheduling_latency_s":0.579442}1443vm-test-run-nixbot-gitlab> gitlab # [  292.359912] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.168Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1444vm-test-run-nixbot-gitlab> gitlab # [  292.363994] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.176Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f3fa9608d7fae004ccb7510b","created_at":"2026-08-20T05:51:04.572Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a9c609006d480b4919bc1190cbbe6e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.577Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f3fa9608d7fae004ccb7510b: done: 0.019736 sec","job_status":"done","queue_duration_s":0.579403,"scheduling_latency_s":0.579442,"redis_calls":7,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001011,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000442,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012086,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019736,"completed_at":"2026-08-20T05:51:05.176Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445vm-test-run-nixbot-gitlab> gitlab # [  292.405269] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.177Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"bddfa0eb52a9a0e5ce946cae","created_at":"2026-08-20T05:51:04.595Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de24d38987bda019222bf5b465211a95","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.610Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-bddfa0eb52a9a0e5ce946cae: start","job_status":"start","queue_duration_s":0.567702,"scheduling_latency_s":0.567733}1446vm-test-run-nixbot-gitlab> gitlab # [  292.419480] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"bddfa0eb52a9a0e5ce946cae","created_at":"2026-08-20T05:51:04.595Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"de24d38987bda019222bf5b465211a95","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.610Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-bddfa0eb52a9a0e5ce946cae: done: 0.026277 sec","job_status":"done","queue_duration_s":0.567702,"scheduling_latency_s":0.567733,"redis_calls":10,"redis_duration_s":0.001863,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001056,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00674248,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.026277,"completed_at":"2026-08-20T05:51:05.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003114,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1447vm-test-run-nixbot-gitlab> gitlab # [  292.462340] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.205Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"abb9f4947772eee0385a5660","created_at":"2026-08-20T05:51:04.620Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f75e798b57ff20f9b906b559dc0f55e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.627Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-abb9f4947772eee0385a5660: start","job_status":"start","queue_duration_s":0.578117,"scheduling_latency_s":0.578147}1448vm-test-run-nixbot-gitlab> gitlab # [  292.476744] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.225Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"abb9f4947772eee0385a5660","created_at":"2026-08-20T05:51:04.620Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f75e798b57ff20f9b906b559dc0f55e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.627Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-abb9f4947772eee0385a5660: done: 0.019663 sec","job_status":"done","queue_duration_s":0.578117,"scheduling_latency_s":0.578147,"redis_calls":9,"redis_duration_s":0.00172,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00086,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00086,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00061518,"exclusive_lock_hold_duration_s":0.00314736,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.019663,"completed_at":"2026-08-20T05:51:05.225Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000989,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449vm-test-run-nixbot-gitlab> gitlab # [  292.519193] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.227Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"6adce831020581b66516a3b9","created_at":"2026-08-20T05:51:04.651Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aca6be4c37a71a0713e7ebe9bf614a45","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.655Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-6adce831020581b66516a3b9: start","job_status":"start","queue_duration_s":0.571326,"scheduling_latency_s":0.571355}1450vm-test-run-nixbot-gitlab> gitlab # [  292.533916] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"6adce831020581b66516a3b9","created_at":"2026-08-20T05:51:04.651Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aca6be4c37a71a0713e7ebe9bf614a45","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.655Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-6adce831020581b66516a3b9: done: 0.038797 sec","job_status":"done","queue_duration_s":0.571326,"scheduling_latency_s":0.571355,"redis_calls":9,"redis_duration_s":0.00148,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000755,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000725,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00054472,"exclusive_lock_hold_duration_s":0.0226058,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.038797,"completed_at":"2026-08-20T05:51:05.265Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011326,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451vm-test-run-nixbot-gitlab> gitlab # [  292.577086] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a58366e636f7f5f63e6ba10a","created_at":"2026-08-20T05:51:04.695Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cae4c4875bc9168b0c304a3906e7efbc","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.709Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a58366e636f7f5f63e6ba10a: start","job_status":"start","queue_duration_s":0.557345,"scheduling_latency_s":0.557365}1452vm-test-run-nixbot-gitlab> gitlab # [  292.660116] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.558Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"a58366e636f7f5f63e6ba10a","created_at":"2026-08-20T05:51:04.695Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cae4c4875bc9168b0c304a3906e7efbc","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.709Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-a58366e636f7f5f63e6ba10a: done: 0.291385 sec","job_status":"done","queue_duration_s":0.557345,"scheduling_latency_s":0.557365,"redis_calls":562,"redis_duration_s":0.054822,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.05394,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.270132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.291385,"completed_at":"2026-08-20T05:51:05.558Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453vm-test-run-nixbot-gitlab> gitlab # [  292.700696] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.560Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6c69700bc397da45e0808317","created_at":"2026-08-20T05:51:04.724Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.729Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6c69700bc397da45e0808317: start","job_status":"start","queue_duration_s":0.831034,"scheduling_latency_s":0.831062}1454vm-test-run-nixbot-gitlab> gitlab # [  292.755301] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"6c69700bc397da45e0808317","created_at":"2026-08-20T05:51:04.724Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.729Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-6c69700bc397da45e0808317: done: 0.093677 sec","job_status":"done","queue_duration_s":0.831034,"scheduling_latency_s":0.831062,"redis_calls":60,"redis_duration_s":0.016255,"redis_read_bytes":108,"redis_write_bytes":41059,"redis_queues_calls":2,"redis_queues_duration_s":0.000834,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013594,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001827,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.093677,"completed_at":"2026-08-20T05:51:05.654Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455vm-test-run-nixbot-gitlab> gitlab # [  292.809394] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.656Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e73c81defe67f5fcbc8f4658","created_at":"2026-08-20T05:51:04.746Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d431b1fee714804561f347cb03a3b46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:51:04.753Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e73c81defe67f5fcbc8f4658: start","job_status":"start","queue_duration_s":0.902346,"scheduling_latency_s":0.902371}1456vm-test-run-nixbot-gitlab> gitlab # [  292.822689] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.677Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e73c81defe67f5fcbc8f4658","created_at":"2026-08-20T05:51:04.746Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d431b1fee714804561f347cb03a3b46","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:51:04.753Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e73c81defe67f5fcbc8f4658: done: 0.021448 sec","job_status":"done","queue_duration_s":0.902346,"scheduling_latency_s":0.902371,"redis_calls":8,"redis_duration_s":0.001774,"redis_read_bytes":133,"redis_write_bytes":811,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00041,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021448,"completed_at":"2026-08-20T05:51:05.677Z","load_balancing_strategy":"primary","db_duration_s":0.000983,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457vm-test-run-nixbot-gitlab> gitlab # [  292.863551] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.678Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"43a161b5fb9db137d3368f36","created_at":"2026-08-20T05:51:04.819Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a6b39ca435fd0a9e9c430df569bad90","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.829Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-43a161b5fb9db137d3368f36: start","job_status":"start","queue_duration_s":0.848777,"scheduling_latency_s":0.848797}1458vm-test-run-nixbot-gitlab> gitlab # [  292.877676] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.696Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"43a161b5fb9db137d3368f36","created_at":"2026-08-20T05:51:04.819Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a6b39ca435fd0a9e9c430df569bad90","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.829Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-43a161b5fb9db137d3368f36: done: 0.018012 sec","job_status":"done","queue_duration_s":0.848777,"scheduling_latency_s":0.848797,"redis_calls":8,"redis_duration_s":0.001348,"redis_read_bytes":133,"redis_write_bytes":875,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000145,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000327,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.018012,"completed_at":"2026-08-20T05:51:05.696Z","load_balancing_strategy":"primary","db_duration_s":0.002616,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459vm-test-run-nixbot-gitlab> gitlab # [  292.919626] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.698Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1bd202f122563bcbc1ac2bb9","created_at":"2026-08-20T05:51:04.861Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d512d16fb979b99f45a1a430e3cd5323","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.870Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1bd202f122563bcbc1ac2bb9: start","job_status":"start","queue_duration_s":0.827361,"scheduling_latency_s":0.827379}1460vm-test-run-nixbot-gitlab> gitlab # [  292.935376] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.711Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"1bd202f122563bcbc1ac2bb9","created_at":"2026-08-20T05:51:04.861Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d512d16fb979b99f45a1a430e3cd5323","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.870Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-1bd202f122563bcbc1ac2bb9: done: 0.013012 sec","job_status":"done","queue_duration_s":0.827361,"scheduling_latency_s":0.827379,"redis_calls":7,"redis_duration_s":0.001148,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000815,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000333,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013012,"completed_at":"2026-08-20T05:51:05.711Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461vm-test-run-nixbot-gitlab> gitlab # [  292.976176] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.712Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"acf4ff7e9b5528713d119bfc","created_at":"2026-08-20T05:51:04.882Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ff2acc142caa570f3d738415e772e1b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.890Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-acf4ff7e9b5528713d119bfc: start","job_status":"start","queue_duration_s":0.82131,"scheduling_latency_s":0.821327}1462vm-test-run-nixbot-gitlab> gitlab # [  292.989905] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.731Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"acf4ff7e9b5528713d119bfc","created_at":"2026-08-20T05:51:04.882Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ff2acc142caa570f3d738415e772e1b","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.890Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-acf4ff7e9b5528713d119bfc: done: 0.019672 sec","job_status":"done","queue_duration_s":0.82131,"scheduling_latency_s":0.821327,"redis_calls":7,"redis_duration_s":0.001263,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000348,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019672,"completed_at":"2026-08-20T05:51:05.731Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004166,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463vm-test-run-nixbot-gitlab> gitlab # [  293.030050] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.733Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"a67bd827efe8c168093eca05","created_at":"2026-08-20T05:51:04.900Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59cfca4a1f9db654cd6f225100d83dfe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:51:04.905Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-a67bd827efe8c168093eca05: start","job_status":"start","queue_duration_s":0.828026,"scheduling_latency_s":0.828045}1464vm-test-run-nixbot-gitlab> gitlab # [  293.043498] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.740Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1465vm-test-run-nixbot-gitlab> gitlab # [  293.046972] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"a67bd827efe8c168093eca05","created_at":"2026-08-20T05:51:04.900Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59cfca4a1f9db654cd6f225100d83dfe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:51:04.905Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-a67bd827efe8c168093eca05: done: 0.012189 sec","job_status":"done","queue_duration_s":0.828026,"scheduling_latency_s":0.828045,"redis_calls":7,"redis_duration_s":0.001315,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000374,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012189,"completed_at":"2026-08-20T05:51:05.745Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466vm-test-run-nixbot-gitlab> gitlab # [  293.086252] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.746Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ec814c3ddd8d817f3efcf512","created_at":"2026-08-20T05:51:04.911Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81fb192e670262c9ad385d8129fac581","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.915Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ec814c3ddd8d817f3efcf512: start","job_status":"start","queue_duration_s":0.831438,"scheduling_latency_s":0.831455}1467vm-test-run-nixbot-gitlab> gitlab # [  293.101099] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.754Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1468vm-test-run-nixbot-gitlab> gitlab # [  293.104796] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.759Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ec814c3ddd8d817f3efcf512","created_at":"2026-08-20T05:51:04.911Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"81fb192e670262c9ad385d8129fac581","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.915Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ec814c3ddd8d817f3efcf512: done: 0.012371 sec","job_status":"done","queue_duration_s":0.831438,"scheduling_latency_s":0.831455,"redis_calls":7,"redis_duration_s":0.001435,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001021,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000414,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012371,"completed_at":"2026-08-20T05:51:05.759Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469vm-test-run-nixbot-gitlab> gitlab # [  293.146527] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.760Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"fd03f3db644d5319adb23097","created_at":"2026-08-20T05:51:04.950Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0999e30be6a93dd6703e35a1f74e474","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.963Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-fd03f3db644d5319adb23097: start","job_status":"start","queue_duration_s":0.797532,"scheduling_latency_s":0.797551}1470vm-test-run-nixbot-gitlab> gitlab # [  293.161394] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.768Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1471vm-test-run-nixbot-gitlab> gitlab # [  293.164603] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.773Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"fd03f3db644d5319adb23097","created_at":"2026-08-20T05:51:04.950Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0999e30be6a93dd6703e35a1f74e474","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.963Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-fd03f3db644d5319adb23097: done: 0.012606 sec","job_status":"done","queue_duration_s":0.797532,"scheduling_latency_s":0.797551,"redis_calls":7,"redis_duration_s":0.001638,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001176,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012606,"completed_at":"2026-08-20T05:51:05.773Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472vm-test-run-nixbot-gitlab> gitlab # [  293.204966] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:05.775Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"aba2221e6e410a712fc7b200","created_at":"2026-08-20T05:51:04.987Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7cbdc8aabb89d5985a8992bce8aa23e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.990Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-aba2221e6e410a712fc7b200: start","job_status":"start","queue_duration_s":0.784581,"scheduling_latency_s":0.7846}1473vm-test-run-nixbot-gitlab> gitlab # [  293.218781] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"aba2221e6e410a712fc7b200","created_at":"2026-08-20T05:51:04.987Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e7cbdc8aabb89d5985a8992bce8aa23e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:04.990Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-aba2221e6e410a712fc7b200: done: 0.245125 sec","job_status":"done","queue_duration_s":0.784581,"scheduling_latency_s":0.7846,"redis_calls":9,"redis_duration_s":0.0026119999999999997,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001278,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001334,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.049,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.174346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005864,"exclusive_lock_hold_duration_s":0.22955626,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.245125,"completed_at":"2026-08-20T05:51:06.020Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.080319,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474vm-test-run-nixbot-gitlab> gitlab # [  293.261390] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.022Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"204768c8f98a9c1de7b49ed3","created_at":"2026-08-20T05:51:04.999Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef0c61286600b788d6826e9cbd58b335","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.002Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-204768c8f98a9c1de7b49ed3: start","job_status":"start","queue_duration_s":1.019678,"scheduling_latency_s":1.019702}1475vm-test-run-nixbot-gitlab> gitlab # [  293.275386] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.038Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"204768c8f98a9c1de7b49ed3","created_at":"2026-08-20T05:51:04.999Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef0c61286600b788d6826e9cbd58b335","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.002Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-204768c8f98a9c1de7b49ed3: done: 0.016599 sec","job_status":"done","queue_duration_s":1.019678,"scheduling_latency_s":1.019702,"redis_calls":7,"redis_duration_s":0.001951,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016599,"completed_at":"2026-08-20T05:51:06.038Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000949,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476vm-test-run-nixbot-gitlab> gitlab # [  293.315276] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.040Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"73d90de6851ad8646f3e9160","created_at":"2026-08-20T05:51:05.021Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd9365d452dee3270a74a1591a1af9d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.028Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-73d90de6851ad8646f3e9160: start","job_status":"start","queue_duration_s":1.011592,"scheduling_latency_s":1.011613}1477vm-test-run-nixbot-gitlab> gitlab # [  293.330124] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.087Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"73d90de6851ad8646f3e9160","created_at":"2026-08-20T05:51:05.021Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-aacb122f442f4c04","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd9365d452dee3270a74a1591a1af9d1","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.028Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-73d90de6851ad8646f3e9160: done: 0.046878 sec","job_status":"done","queue_duration_s":1.011592,"scheduling_latency_s":1.011613,"redis_calls":9,"redis_duration_s":0.0028250000000000003,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001327,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001498,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00087306,"exclusive_lock_hold_duration_s":0.0218928,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.046878,"completed_at":"2026-08-20T05:51:06.087Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023738,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478vm-test-run-nixbot-gitlab> gitlab # [  293.374250] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.089Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8688f6cdd09a9d635e3fc5a9","created_at":"2026-08-20T05:51:05.120Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-7206f86f6f204010","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"132db6894ad70ff86dd6fe9fdd017a88","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.142Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8688f6cdd09a9d635e3fc5a9: start","job_status":"start","queue_duration_s":0.946173,"scheduling_latency_s":0.946192}1479vm-test-run-nixbot-gitlab> gitlab # [  293.386518] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.101Z","message":"No existing merge request to be cleaned up."}1480vm-test-run-nixbot-gitlab> gitlab # [  293.388161] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.111Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8688f6cdd09a9d635e3fc5a9","created_at":"2026-08-20T05:51:05.120Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-7206f86f6f204010","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"132db6894ad70ff86dd6fe9fdd017a88","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.142Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8688f6cdd09a9d635e3fc5a9: done: 0.022663 sec","job_status":"done","queue_duration_s":0.946173,"scheduling_latency_s":0.946192,"redis_calls":10,"redis_duration_s":0.0029389999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001194,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022663,"completed_at":"2026-08-20T05:51:06.111Z","load_balancing_strategy":"primary","db_duration_s":0.003109,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481vm-test-run-nixbot-gitlab> gitlab # [  293.426227] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.113Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6372544289c36d1bd2307086","created_at":"2026-08-20T05:51:05.120Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-7206f86f6f204010","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"132db6894ad70ff86dd6fe9fdd017a88","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.142Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6372544289c36d1bd2307086: start","job_status":"start","queue_duration_s":0.970469,"scheduling_latency_s":0.970487}1482vm-test-run-nixbot-gitlab> gitlab # [  293.438498] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.125Z","message":"No existing merge request to be cleaned up."}1483vm-test-run-nixbot-gitlab> gitlab # [  293.440150] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.134Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6372544289c36d1bd2307086","created_at":"2026-08-20T05:51:05.120Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-7206f86f6f204010","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"132db6894ad70ff86dd6fe9fdd017a88","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.142Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6372544289c36d1bd2307086: done: 0.021361 sec","job_status":"done","queue_duration_s":0.970469,"scheduling_latency_s":0.970487,"redis_calls":10,"redis_duration_s":0.00277,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001174,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001596,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021361,"completed_at":"2026-08-20T05:51:06.134Z","load_balancing_strategy":"primary","db_duration_s":0.003016,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484vm-test-run-nixbot-gitlab> gitlab # [  293.478358] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.136Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8dedb769cfcd86eacd7ea9fd","created_at":"2026-08-20T05:51:05.120Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-7206f86f6f204010","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"132db6894ad70ff86dd6fe9fdd017a88","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.142Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8dedb769cfcd86eacd7ea9fd: start","job_status":"start","queue_duration_s":0.993398,"scheduling_latency_s":0.993417}1485vm-test-run-nixbot-gitlab> gitlab # [  293.490641] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.147Z","message":"No existing merge request to be cleaned up."}1486vm-test-run-nixbot-gitlab> gitlab # [  293.492292] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.157Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8dedb769cfcd86eacd7ea9fd","created_at":"2026-08-20T05:51:05.120Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-7206f86f6f204010","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"132db6894ad70ff86dd6fe9fdd017a88","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.142Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8dedb769cfcd86eacd7ea9fd: done: 0.020965 sec","job_status":"done","queue_duration_s":0.993398,"scheduling_latency_s":0.993417,"redis_calls":10,"redis_duration_s":0.0027600000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001137,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001623,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020965,"completed_at":"2026-08-20T05:51:06.157Z","load_balancing_strategy":"primary","db_duration_s":0.002672,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487vm-test-run-nixbot-gitlab> gitlab # [  293.530404] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.158Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c70ae1cb5aa4a51d3f746a28","created_at":"2026-08-20T05:51:05.120Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-7206f86f6f204010","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"132db6894ad70ff86dd6fe9fdd017a88","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.142Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c70ae1cb5aa4a51d3f746a28: start","job_status":"start","queue_duration_s":1.015889,"scheduling_latency_s":1.015906}1488vm-test-run-nixbot-gitlab> gitlab # [  293.543025] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.170Z","message":"No existing merge request to be cleaned up."}1489vm-test-run-nixbot-gitlab> gitlab # [  293.545861] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.178Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c70ae1cb5aa4a51d3f746a28","created_at":"2026-08-20T05:51:05.120Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-7206f86f6f204010","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"132db6894ad70ff86dd6fe9fdd017a88","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.142Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c70ae1cb5aa4a51d3f746a28: done: 0.019916 sec","job_status":"done","queue_duration_s":1.015889,"scheduling_latency_s":1.015906,"redis_calls":10,"redis_duration_s":0.0027229999999999997,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00162,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019916,"completed_at":"2026-08-20T05:51:06.178Z","load_balancing_strategy":"primary","db_duration_s":0.002697,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490vm-test-run-nixbot-gitlab> gitlab # [  293.584684] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"724c917d4a3f57c638fa455e","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-724c917d4a3f57c638fa455e: start","job_status":"start","queue_duration_s":0.534893,"scheduling_latency_s":0.534912}1491vm-test-run-nixbot-gitlab> gitlab # [  293.597125] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"724c917d4a3f57c638fa455e","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-724c917d4a3f57c638fa455e: done: 0.01525 sec","job_status":"done","queue_duration_s":0.534893,"scheduling_latency_s":0.534912,"redis_calls":13,"redis_duration_s":0.002835,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01525,"completed_at":"2026-08-20T05:51:06.195Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492vm-test-run-nixbot-gitlab> gitlab # [  293.636821] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.196Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"684f983bd6c231028fe03124","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-684f983bd6c231028fe03124: start","job_status":"start","queue_duration_s":0.551566,"scheduling_latency_s":0.551583}1493vm-test-run-nixbot-gitlab> gitlab # [  293.649207] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"684f983bd6c231028fe03124","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-684f983bd6c231028fe03124: done: 0.015187 sec","job_status":"done","queue_duration_s":0.551566,"scheduling_latency_s":0.551583,"redis_calls":13,"redis_duration_s":0.002861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015187,"completed_at":"2026-08-20T05:51:06.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1494vm-test-run-nixbot-gitlab> gitlab # [  293.689003] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a605b4289d2564e91501c75","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a605b4289d2564e91501c75: start","job_status":"start","queue_duration_s":0.568209,"scheduling_latency_s":0.568226}1495vm-test-run-nixbot-gitlab> gitlab # [  293.701452] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a605b4289d2564e91501c75","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a605b4289d2564e91501c75: done: 0.014952 sec","job_status":"done","queue_duration_s":0.568209,"scheduling_latency_s":0.568226,"redis_calls":13,"redis_duration_s":0.0027619999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001795,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014952,"completed_at":"2026-08-20T05:51:06.228Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496vm-test-run-nixbot-gitlab> gitlab # [  293.740854] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5ef98f81747d2b27c890dee","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5ef98f81747d2b27c890dee: start","job_status":"start","queue_duration_s":0.584548,"scheduling_latency_s":0.584564}1497vm-test-run-nixbot-gitlab> gitlab # [  293.753313] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5ef98f81747d2b27c890dee","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5ef98f81747d2b27c890dee: done: 0.015514 sec","job_status":"done","queue_duration_s":0.584548,"scheduling_latency_s":0.584564,"redis_calls":13,"redis_duration_s":0.002922,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009456,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015514,"completed_at":"2026-08-20T05:51:06.245Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498vm-test-run-nixbot-gitlab> gitlab # [  293.793266] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0f8cc9d3d8d8244e427ecbd","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0f8cc9d3d8d8244e427ecbd: start","job_status":"start","queue_duration_s":0.601556,"scheduling_latency_s":0.601572}1499vm-test-run-nixbot-gitlab> gitlab # [  293.805737] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0f8cc9d3d8d8244e427ecbd","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0f8cc9d3d8d8244e427ecbd: done: 0.014781 sec","job_status":"done","queue_duration_s":0.601556,"scheduling_latency_s":0.601572,"redis_calls":13,"redis_duration_s":0.002715,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014781,"completed_at":"2026-08-20T05:51:06.261Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500vm-test-run-nixbot-gitlab> gitlab # [  293.844964] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c26292e7e0f43d43e03c0f7e","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c26292e7e0f43d43e03c0f7e: start","job_status":"start","queue_duration_s":0.61771,"scheduling_latency_s":0.617727}1501vm-test-run-nixbot-gitlab> gitlab # [  293.857161] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c26292e7e0f43d43e03c0f7e","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c26292e7e0f43d43e03c0f7e: done: 0.014609 sec","job_status":"done","queue_duration_s":0.61771,"scheduling_latency_s":0.617727,"redis_calls":13,"redis_duration_s":0.002744,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001807,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014609,"completed_at":"2026-08-20T05:51:06.277Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502vm-test-run-nixbot-gitlab> gitlab # [  293.896609] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b410ff63f1dcf0db37168e40","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b410ff63f1dcf0db37168e40: start","job_status":"start","queue_duration_s":0.634463,"scheduling_latency_s":0.634481}1503vm-test-run-nixbot-gitlab> gitlab # [  293.908912] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b410ff63f1dcf0db37168e40","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b410ff63f1dcf0db37168e40: done: 0.014702 sec","job_status":"done","queue_duration_s":0.634463,"scheduling_latency_s":0.634481,"redis_calls":13,"redis_duration_s":0.002702,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001785,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014702,"completed_at":"2026-08-20T05:51:06.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504vm-test-run-nixbot-gitlab> gitlab # [  293.948285] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70652a892ca4f00d2f768afc","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70652a892ca4f00d2f768afc: start","job_status":"start","queue_duration_s":0.650624,"scheduling_latency_s":0.650642}1505vm-test-run-nixbot-gitlab> gitlab # [  293.960337] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70652a892ca4f00d2f768afc","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70652a892ca4f00d2f768afc: done: 0.02209 sec","job_status":"done","queue_duration_s":0.650624,"scheduling_latency_s":0.650642,"redis_calls":13,"redis_duration_s":0.003979,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002795,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02209,"completed_at":"2026-08-20T05:51:06.318Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506vm-test-run-nixbot-gitlab> gitlab # [  294.000427] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"555460e830546789fe7a1a66","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-555460e830546789fe7a1a66: start","job_status":"start","queue_duration_s":0.674603,"scheduling_latency_s":0.674622}1507vm-test-run-nixbot-gitlab> gitlab # [  294.012729] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"555460e830546789fe7a1a66","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-555460e830546789fe7a1a66: done: 0.015253 sec","job_status":"done","queue_duration_s":0.674603,"scheduling_latency_s":0.674622,"redis_calls":13,"redis_duration_s":0.002896,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000979,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015253,"completed_at":"2026-08-20T05:51:06.335Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508vm-test-run-nixbot-gitlab> gitlab # [  294.051850] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfbaf4003849e415ee04bfaa","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfbaf4003849e415ee04bfaa: start","job_status":"start","queue_duration_s":0.691485,"scheduling_latency_s":0.691502}1509vm-test-run-nixbot-gitlab> gitlab # [  294.064502] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfbaf4003849e415ee04bfaa","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfbaf4003849e415ee04bfaa: done: 0.014967 sec","job_status":"done","queue_duration_s":0.691485,"scheduling_latency_s":0.691502,"redis_calls":13,"redis_duration_s":0.002707,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001795,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009069,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014967,"completed_at":"2026-08-20T05:51:06.351Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1510vm-test-run-nixbot-gitlab> gitlab # [  294.103808] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1484a25160dad7a4a12f4bd4","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1484a25160dad7a4a12f4bd4: start","job_status":"start","queue_duration_s":0.707784,"scheduling_latency_s":0.707799}1511vm-test-run-nixbot-gitlab> gitlab # [  294.116515] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1484a25160dad7a4a12f4bd4","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1484a25160dad7a4a12f4bd4: done: 0.01438 sec","job_status":"done","queue_duration_s":0.707784,"scheduling_latency_s":0.707799,"redis_calls":13,"redis_duration_s":0.002585,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001707,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01438,"completed_at":"2026-08-20T05:51:06.367Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1512vm-test-run-nixbot-gitlab> gitlab # [  294.155534] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"905d8d742ee58a3beff660f7","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-905d8d742ee58a3beff660f7: start","job_status":"start","queue_duration_s":0.723519,"scheduling_latency_s":0.723535}1513vm-test-run-nixbot-gitlab> gitlab # [  294.168161] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"905d8d742ee58a3beff660f7","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-905d8d742ee58a3beff660f7: done: 0.015277 sec","job_status":"done","queue_duration_s":0.723519,"scheduling_latency_s":0.723535,"redis_calls":13,"redis_duration_s":0.003168,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001379,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001789,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015277,"completed_at":"2026-08-20T05:51:06.384Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1514vm-test-run-nixbot-gitlab> gitlab # [  294.208622] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77b8cfe2c2b0b4e2c0c19184","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77b8cfe2c2b0b4e2c0c19184: start","job_status":"start","queue_duration_s":0.740348,"scheduling_latency_s":0.740365}1515vm-test-run-nixbot-gitlab> gitlab # [  294.220749] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77b8cfe2c2b0b4e2c0c19184","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77b8cfe2c2b0b4e2c0c19184: done: 0.014758 sec","job_status":"done","queue_duration_s":0.740348,"scheduling_latency_s":0.740365,"redis_calls":13,"redis_duration_s":0.0027199999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001772,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009083,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014758,"completed_at":"2026-08-20T05:51:06.400Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1516vm-test-run-nixbot-gitlab> gitlab # [  294.260218] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27633a901979f05198042f71","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27633a901979f05198042f71: start","job_status":"start","queue_duration_s":0.7566,"scheduling_latency_s":0.756616}1517vm-test-run-nixbot-gitlab> gitlab # [  294.272481] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27633a901979f05198042f71","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27633a901979f05198042f71: done: 0.014746 sec","job_status":"done","queue_duration_s":0.7566,"scheduling_latency_s":0.756616,"redis_calls":13,"redis_duration_s":0.002738,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001786,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014746,"completed_at":"2026-08-20T05:51:06.416Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1518vm-test-run-nixbot-gitlab> gitlab # [  294.312613] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"008eca895e6c1b2b04180c24","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-008eca895e6c1b2b04180c24: start","job_status":"start","queue_duration_s":0.772711,"scheduling_latency_s":0.772727}1519vm-test-run-nixbot-gitlab> gitlab # [  294.325208] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"008eca895e6c1b2b04180c24","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-008eca895e6c1b2b04180c24: done: 0.014547 sec","job_status":"done","queue_duration_s":0.772711,"scheduling_latency_s":0.772727,"redis_calls":13,"redis_duration_s":0.0025640000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001649,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014547,"completed_at":"2026-08-20T05:51:06.432Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520vm-test-run-nixbot-gitlab> gitlab # [  294.364591] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6970b52e4fbe104cf77ed75a","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6970b52e4fbe104cf77ed75a: start","job_status":"start","queue_duration_s":0.788642,"scheduling_latency_s":0.788657}1521vm-test-run-nixbot-gitlab> gitlab # [  294.377194] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6970b52e4fbe104cf77ed75a","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6970b52e4fbe104cf77ed75a: done: 0.014787 sec","job_status":"done","queue_duration_s":0.788642,"scheduling_latency_s":0.788657,"redis_calls":13,"redis_duration_s":0.002771,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001855,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014787,"completed_at":"2026-08-20T05:51:06.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522vm-test-run-nixbot-gitlab> gitlab # [  294.418068] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2be9127f12b8ff474639ffc2","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2be9127f12b8ff474639ffc2: start","job_status":"start","queue_duration_s":0.804835,"scheduling_latency_s":0.804849}1523vm-test-run-nixbot-gitlab> gitlab # [  294.430747] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2be9127f12b8ff474639ffc2","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2be9127f12b8ff474639ffc2: done: 0.014672 sec","job_status":"done","queue_duration_s":0.804835,"scheduling_latency_s":0.804849,"redis_calls":13,"redis_duration_s":0.002558,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001627,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014672,"completed_at":"2026-08-20T05:51:06.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524vm-test-run-nixbot-gitlab> gitlab # [  294.470469] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.466Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce8c75846f0fa8bb593e6b30","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce8c75846f0fa8bb593e6b30: start","job_status":"start","queue_duration_s":0.820923,"scheduling_latency_s":0.820939}1525vm-test-run-nixbot-gitlab> gitlab # [  294.483214] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce8c75846f0fa8bb593e6b30","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce8c75846f0fa8bb593e6b30: done: 0.014843 sec","job_status":"done","queue_duration_s":0.820923,"scheduling_latency_s":0.820939,"redis_calls":13,"redis_duration_s":0.0028910000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014843,"completed_at":"2026-08-20T05:51:06.481Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526vm-test-run-nixbot-gitlab> gitlab # [  294.523238] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.482Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1633c3c5963aadc441ec4284","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1633c3c5963aadc441ec4284: start","job_status":"start","queue_duration_s":0.83717,"scheduling_latency_s":0.837186}1527vm-test-run-nixbot-gitlab> gitlab # [  294.535894] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1633c3c5963aadc441ec4284","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1633c3c5963aadc441ec4284: done: 0.107985 sec","job_status":"done","queue_duration_s":0.83717,"scheduling_latency_s":0.837186,"redis_calls":13,"redis_duration_s":0.004024,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001008,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.107985,"completed_at":"2026-08-20T05:51:06.590Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528vm-test-run-nixbot-gitlab> gitlab # [  294.575655] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aae839d4c401097db6d414f3","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aae839d4c401097db6d414f3: start","job_status":"start","queue_duration_s":0.946748,"scheduling_latency_s":0.946771}1529vm-test-run-nixbot-gitlab> gitlab # [  294.588046] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aae839d4c401097db6d414f3","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aae839d4c401097db6d414f3: done: 0.014841 sec","job_status":"done","queue_duration_s":0.946748,"scheduling_latency_s":0.946771,"redis_calls":13,"redis_duration_s":0.002698,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001775,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014841,"completed_at":"2026-08-20T05:51:06.606Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530vm-test-run-nixbot-gitlab> gitlab # [  294.628502] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"919781f9ee49db88df4140b7","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-919781f9ee49db88df4140b7: start","job_status":"start","queue_duration_s":0.96387,"scheduling_latency_s":0.963889}1531vm-test-run-nixbot-gitlab> gitlab # [  294.640805] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"919781f9ee49db88df4140b7","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-919781f9ee49db88df4140b7: done: 0.015584 sec","job_status":"done","queue_duration_s":0.96387,"scheduling_latency_s":0.963889,"redis_calls":13,"redis_duration_s":0.003332,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001755,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001577,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015584,"completed_at":"2026-08-20T05:51:06.624Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1532vm-test-run-nixbot-gitlab> gitlab # [  294.680189] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87e1c2420cc85475517464d8","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87e1c2420cc85475517464d8: start","job_status":"start","queue_duration_s":0.980852,"scheduling_latency_s":0.980869}1533vm-test-run-nixbot-gitlab> gitlab # [  294.693329] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87e1c2420cc85475517464d8","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87e1c2420cc85475517464d8: done: 0.015726 sec","job_status":"done","queue_duration_s":0.980852,"scheduling_latency_s":0.980869,"redis_calls":13,"redis_duration_s":0.0027530000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001823,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015726,"completed_at":"2026-08-20T05:51:06.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534vm-test-run-nixbot-gitlab> gitlab # [  294.733092] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3ea69601f7f893d72424da3","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3ea69601f7f893d72424da3: start","job_status":"start","queue_duration_s":0.997895,"scheduling_latency_s":0.997912}1535vm-test-run-nixbot-gitlab> gitlab # [  294.745470] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3ea69601f7f893d72424da3","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3ea69601f7f893d72424da3: done: 0.033241 sec","job_status":"done","queue_duration_s":0.997895,"scheduling_latency_s":0.997912,"redis_calls":13,"redis_duration_s":0.0042899999999999995,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001684,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002606,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033241,"completed_at":"2026-08-20T05:51:06.676Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536vm-test-run-nixbot-gitlab> gitlab # [  294.784670] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9deb586b7151d696f51ff232","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9deb586b7151d696f51ff232: start","job_status":"start","queue_duration_s":1.035656,"scheduling_latency_s":1.035706}1537vm-test-run-nixbot-gitlab> gitlab # [  294.797350] setup-gitlab-start[3113]: W, [2026-08-20T05:51:07.619550 #3113]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1538vm-test-run-nixbot-gitlab> gitlab # [  294.799294] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9deb586b7151d696f51ff232","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9deb586b7151d696f51ff232: done: 0.032658 sec","job_status":"done","queue_duration_s":1.035656,"scheduling_latency_s":1.035706,"redis_calls":13,"redis_duration_s":0.0037739999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002691,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032658,"completed_at":"2026-08-20T05:51:06.713Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539vm-test-run-nixbot-gitlab> gitlab # [  294.839677] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f4b28a926bf76263d305cc1","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f4b28a926bf76263d305cc1: start","job_status":"start","queue_duration_s":1.070453,"scheduling_latency_s":1.07048}1540vm-test-run-nixbot-gitlab> gitlab # [  294.852297] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f4b28a926bf76263d305cc1","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f4b28a926bf76263d305cc1: done: 0.024601 sec","job_status":"done","queue_duration_s":1.070453,"scheduling_latency_s":1.07048,"redis_calls":13,"redis_duration_s":0.003587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001232,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002355,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024601,"completed_at":"2026-08-20T05:51:06.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541vm-test-run-nixbot-gitlab> gitlab # [  294.891496] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e5ba449193e368b98cc9fc2","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e5ba449193e368b98cc9fc2: start","job_status":"start","queue_duration_s":1.096947,"scheduling_latency_s":1.096972}1542vm-test-run-nixbot-gitlab> gitlab # [  294.904213] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e5ba449193e368b98cc9fc2","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e5ba449193e368b98cc9fc2: done: 0.021967 sec","job_status":"done","queue_duration_s":1.096947,"scheduling_latency_s":1.096972,"redis_calls":13,"redis_duration_s":0.003209,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002152,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021967,"completed_at":"2026-08-20T05:51:06.764Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543vm-test-run-nixbot-gitlab> gitlab # [  294.943412] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31739529aec6583c470e5360","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31739529aec6583c470e5360: start","job_status":"start","queue_duration_s":1.120613,"scheduling_latency_s":1.120638}1544vm-test-run-nixbot-gitlab> gitlab # [  294.956032] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31739529aec6583c470e5360","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31739529aec6583c470e5360: done: 0.016544 sec","job_status":"done","queue_duration_s":1.120613,"scheduling_latency_s":1.120638,"redis_calls":13,"redis_duration_s":0.002513,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001608,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016544,"completed_at":"2026-08-20T05:51:06.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545vm-test-run-nixbot-gitlab> gitlab # [  294.995217] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adf5be5bf6b91f28c24db982","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adf5be5bf6b91f28c24db982: start","job_status":"start","queue_duration_s":1.139873,"scheduling_latency_s":1.139891}1546vm-test-run-nixbot-gitlab> gitlab # [  295.007659] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adf5be5bf6b91f28c24db982","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adf5be5bf6b91f28c24db982: done: 0.015711 sec","job_status":"done","queue_duration_s":1.139873,"scheduling_latency_s":1.139891,"redis_calls":13,"redis_duration_s":0.002587,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00166,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015711,"completed_at":"2026-08-20T05:51:06.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547vm-test-run-nixbot-gitlab> gitlab # [  295.048256] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"829c3bcd876981fbad1e99db","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-829c3bcd876981fbad1e99db: start","job_status":"start","queue_duration_s":1.156908,"scheduling_latency_s":1.156924}1548vm-test-run-nixbot-gitlab> gitlab # [  295.060576] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.821Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"829c3bcd876981fbad1e99db","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-829c3bcd876981fbad1e99db: done: 0.019606 sec","job_status":"done","queue_duration_s":1.156908,"scheduling_latency_s":1.156924,"redis_calls":13,"redis_duration_s":0.0028599999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001063,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001797,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019606,"completed_at":"2026-08-20T05:51:06.821Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549vm-test-run-nixbot-gitlab> gitlab # [  295.099748] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56b3b5a9abd9fe75adbdf576","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56b3b5a9abd9fe75adbdf576: start","job_status":"start","queue_duration_s":1.179323,"scheduling_latency_s":1.179363}1550vm-test-run-nixbot-gitlab> gitlab # [  295.112388] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56b3b5a9abd9fe75adbdf576","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56b3b5a9abd9fe75adbdf576: done: 0.036141 sec","job_status":"done","queue_duration_s":1.179323,"scheduling_latency_s":1.179363,"redis_calls":13,"redis_duration_s":0.003358,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001155,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002203,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036141,"completed_at":"2026-08-20T05:51:06.860Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1551vm-test-run-nixbot-gitlab> gitlab # [  295.151681] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e6e3a63e71f8aa63fb8c21d","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e6e3a63e71f8aa63fb8c21d: start","job_status":"start","queue_duration_s":1.219462,"scheduling_latency_s":1.219497}1552vm-test-run-nixbot-gitlab> gitlab # [  295.164287] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e6e3a63e71f8aa63fb8c21d","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e6e3a63e71f8aa63fb8c21d: done: 0.027891 sec","job_status":"done","queue_duration_s":1.219462,"scheduling_latency_s":1.219497,"redis_calls":13,"redis_duration_s":0.00346,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001467,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027891,"completed_at":"2026-08-20T05:51:06.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553vm-test-run-nixbot-gitlab> gitlab # [  295.203259] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55cd8ad92189a246b32fe347","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55cd8ad92189a246b32fe347: start","job_status":"start","queue_duration_s":1.249507,"scheduling_latency_s":1.249537}1554vm-test-run-nixbot-gitlab> gitlab # [  295.215836] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55cd8ad92189a246b32fe347","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55cd8ad92189a246b32fe347: done: 0.02452 sec","job_status":"done","queue_duration_s":1.249507,"scheduling_latency_s":1.249537,"redis_calls":13,"redis_duration_s":0.0033480000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001158,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00219,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02452,"completed_at":"2026-08-20T05:51:06.919Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555vm-test-run-nixbot-gitlab> gitlab # [  295.256560] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49d46b9b987a6ba45d35fa25","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49d46b9b987a6ba45d35fa25: start","job_status":"start","queue_duration_s":1.275818,"scheduling_latency_s":1.275843}1556vm-test-run-nixbot-gitlab> gitlab # [  295.269310] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49d46b9b987a6ba45d35fa25","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49d46b9b987a6ba45d35fa25: done: 0.022543 sec","job_status":"done","queue_duration_s":1.275818,"scheduling_latency_s":1.275843,"redis_calls":13,"redis_duration_s":0.003052,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022543,"completed_at":"2026-08-20T05:51:06.943Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557vm-test-run-nixbot-gitlab> gitlab # [  295.308738] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e10364dd1739d044f5c2564","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e10364dd1739d044f5c2564: start","job_status":"start","queue_duration_s":1.301088,"scheduling_latency_s":1.301112}1558vm-test-run-nixbot-gitlab> gitlab # [  295.321196] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.966Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e10364dd1739d044f5c2564","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e10364dd1739d044f5c2564: done: 0.019724 sec","job_status":"done","queue_duration_s":1.301088,"scheduling_latency_s":1.301112,"redis_calls":13,"redis_duration_s":0.002988,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019724,"completed_at":"2026-08-20T05:51:06.966Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559vm-test-run-nixbot-gitlab> gitlab # [  295.360446] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.968Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da39362ad55f2cdeb0af6be9","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da39362ad55f2cdeb0af6be9: start","job_status":"start","queue_duration_s":1.32263,"scheduling_latency_s":1.322651}1560vm-test-run-nixbot-gitlab> gitlab # [  295.372779] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da39362ad55f2cdeb0af6be9","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da39362ad55f2cdeb0af6be9: done: 0.018249 sec","job_status":"done","queue_duration_s":1.32263,"scheduling_latency_s":1.322651,"redis_calls":13,"redis_duration_s":0.0039959999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018249,"completed_at":"2026-08-20T05:51:06.986Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561vm-test-run-nixbot-gitlab> gitlab # [  295.412416] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:06.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cfea6428d765f5910608bab","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cfea6428d765f5910608bab: start","job_status":"start","queue_duration_s":1.342459,"scheduling_latency_s":1.342477}1562vm-test-run-nixbot-gitlab> gitlab # [  295.425902] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9cfea6428d765f5910608bab","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9cfea6428d765f5910608bab: done: 0.016731 sec","job_status":"done","queue_duration_s":1.342459,"scheduling_latency_s":1.342477,"redis_calls":13,"redis_duration_s":0.0027270000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001765,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016731,"completed_at":"2026-08-20T05:51:07.004Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563vm-test-run-nixbot-gitlab> gitlab # [  295.465491] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6368096d76f7c969a5c22835","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6368096d76f7c969a5c22835: start","job_status":"start","queue_duration_s":1.360649,"scheduling_latency_s":1.360666}1564vm-test-run-nixbot-gitlab> gitlab # [  295.478016] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6368096d76f7c969a5c22835","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6368096d76f7c969a5c22835: done: 0.016227 sec","job_status":"done","queue_duration_s":1.360649,"scheduling_latency_s":1.360666,"redis_calls":13,"redis_duration_s":0.0026939999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016227,"completed_at":"2026-08-20T05:51:07.022Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565vm-test-run-nixbot-gitlab> gitlab # [  295.517196] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6076e054678ca4e378094b8e","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6076e054678ca4e378094b8e: start","job_status":"start","queue_duration_s":1.379135,"scheduling_latency_s":1.379152}1566vm-test-run-nixbot-gitlab> gitlab # [  295.529500] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6076e054678ca4e378094b8e","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6076e054678ca4e378094b8e: done: 0.01637 sec","job_status":"done","queue_duration_s":1.379135,"scheduling_latency_s":1.379152,"redis_calls":13,"redis_duration_s":0.00279,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001856,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01637,"completed_at":"2026-08-20T05:51:07.040Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567vm-test-run-nixbot-gitlab> gitlab # [  295.568608] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"486b733400d4ac032395e873","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-486b733400d4ac032395e873: start","job_status":"start","queue_duration_s":1.396833,"scheduling_latency_s":1.396849}1568vm-test-run-nixbot-gitlab> gitlab # [  295.580900] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.058Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"486b733400d4ac032395e873","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-486b733400d4ac032395e873: done: 0.016222 sec","job_status":"done","queue_duration_s":1.396833,"scheduling_latency_s":1.396849,"redis_calls":13,"redis_duration_s":0.002581,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001656,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016222,"completed_at":"2026-08-20T05:51:07.058Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569vm-test-run-nixbot-gitlab> gitlab # [  295.620524] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62326d98cec81df3aab830c1","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62326d98cec81df3aab830c1: start","job_status":"start","queue_duration_s":1.414539,"scheduling_latency_s":1.414555}1570vm-test-run-nixbot-gitlab> gitlab # [  295.633922] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"62326d98cec81df3aab830c1","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-62326d98cec81df3aab830c1: done: 0.027306 sec","job_status":"done","queue_duration_s":1.414539,"scheduling_latency_s":1.414555,"redis_calls":13,"redis_duration_s":0.003869,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001158,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002711,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027306,"completed_at":"2026-08-20T05:51:07.087Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571vm-test-run-nixbot-gitlab> gitlab # [  295.673175] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"070a453e73ca78e1318a73c9","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-070a453e73ca78e1318a73c9: start","job_status":"start","queue_duration_s":1.445052,"scheduling_latency_s":1.445096}1572vm-test-run-nixbot-gitlab> gitlab # [  295.685665] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"070a453e73ca78e1318a73c9","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-070a453e73ca78e1318a73c9: done: 0.041091 sec","job_status":"done","queue_duration_s":1.445052,"scheduling_latency_s":1.445096,"redis_calls":13,"redis_duration_s":0.004185,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00143,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041091,"completed_at":"2026-08-20T05:51:07.131Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573vm-test-run-nixbot-gitlab> gitlab # [  295.725018] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9143837a930a4dfa648d5d78","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9143837a930a4dfa648d5d78: start","job_status":"start","queue_duration_s":1.488728,"scheduling_latency_s":1.488764}1574vm-test-run-nixbot-gitlab> gitlab # [  295.737559] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9143837a930a4dfa648d5d78","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9143837a930a4dfa648d5d78: done: 0.02844 sec","job_status":"done","queue_duration_s":1.488728,"scheduling_latency_s":1.488764,"redis_calls":13,"redis_duration_s":0.003395,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001169,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002226,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02844,"completed_at":"2026-08-20T05:51:07.162Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575vm-test-run-nixbot-gitlab> gitlab # [  295.776804] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5862dbfc38134470b4c39b9a","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5862dbfc38134470b4c39b9a: start","job_status":"start","queue_duration_s":1.51905,"scheduling_latency_s":1.519079}1576vm-test-run-nixbot-gitlab> gitlab # [  295.789156] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5862dbfc38134470b4c39b9a","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5862dbfc38134470b4c39b9a: done: 0.0216 sec","job_status":"done","queue_duration_s":1.51905,"scheduling_latency_s":1.519079,"redis_calls":13,"redis_duration_s":0.002371,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000854,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001517,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0216,"completed_at":"2026-08-20T05:51:07.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577vm-test-run-nixbot-gitlab> gitlab # [  295.828786] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd971cfba4a4fb74c63bc0eb","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd971cfba4a4fb74c63bc0eb: start","job_status":"start","queue_duration_s":1.542598,"scheduling_latency_s":1.542626}1578vm-test-run-nixbot-gitlab> gitlab # [  295.842768] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd971cfba4a4fb74c63bc0eb","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd971cfba4a4fb74c63bc0eb: done: 0.018649 sec","job_status":"done","queue_duration_s":1.542598,"scheduling_latency_s":1.542626,"redis_calls":13,"redis_duration_s":0.002046,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001304,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018649,"completed_at":"2026-08-20T05:51:07.206Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579vm-test-run-nixbot-gitlab> gitlab # [  295.881873] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"718d280701f21e1772bcb640","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-718d280701f21e1772bcb640: start","job_status":"start","queue_duration_s":1.563628,"scheduling_latency_s":1.563654}1580vm-test-run-nixbot-gitlab> gitlab # [  295.894353] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"718d280701f21e1772bcb640","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-718d280701f21e1772bcb640: done: 0.015933 sec","job_status":"done","queue_duration_s":1.563628,"scheduling_latency_s":1.563654,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015933,"completed_at":"2026-08-20T05:51:07.224Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581vm-test-run-nixbot-gitlab> gitlab # [  295.933517] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bb3cf7deefb82c127d51843","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bb3cf7deefb82c127d51843: start","job_status":"start","queue_duration_s":1.580589,"scheduling_latency_s":1.580605}1582vm-test-run-nixbot-gitlab> gitlab # [  295.945974] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bb3cf7deefb82c127d51843","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bb3cf7deefb82c127d51843: done: 0.01504 sec","job_status":"done","queue_duration_s":1.580589,"scheduling_latency_s":1.580605,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01504,"completed_at":"2026-08-20T05:51:07.240Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583vm-test-run-nixbot-gitlab> gitlab # [  295.984869] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.242Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1498a0d355ec2605b918aa87","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1498a0d355ec2605b918aa87: start","job_status":"start","queue_duration_s":1.596691,"scheduling_latency_s":1.596709}1584vm-test-run-nixbot-gitlab> gitlab # [  295.997302] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1498a0d355ec2605b918aa87","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1498a0d355ec2605b918aa87: done: 0.015329 sec","job_status":"done","queue_duration_s":1.596691,"scheduling_latency_s":1.596709,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001033,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015329,"completed_at":"2026-08-20T05:51:07.257Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585vm-test-run-nixbot-gitlab> gitlab # [  296.036647] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.258Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f92c65a37852ad173a29e79","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f92c65a37852ad173a29e79: start","job_status":"start","queue_duration_s":1.613099,"scheduling_latency_s":1.613115}1586vm-test-run-nixbot-gitlab> gitlab # [  296.050039] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f92c65a37852ad173a29e79","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f92c65a37852ad173a29e79: done: 0.015939 sec","job_status":"done","queue_duration_s":1.613099,"scheduling_latency_s":1.613115,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015939,"completed_at":"2026-08-20T05:51:07.274Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587vm-test-run-nixbot-gitlab> gitlab # [  296.088706] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a5ad47f65335708e2c3e5f8","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a5ad47f65335708e2c3e5f8: start","job_status":"start","queue_duration_s":1.630291,"scheduling_latency_s":1.630309}1588vm-test-run-nixbot-gitlab> gitlab # [  296.101050] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a5ad47f65335708e2c3e5f8","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a5ad47f65335708e2c3e5f8: done: 0.015708 sec","job_status":"done","queue_duration_s":1.630291,"scheduling_latency_s":1.630309,"redis_calls":13,"redis_duration_s":0.001807,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001207,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015708,"completed_at":"2026-08-20T05:51:07.291Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589vm-test-run-nixbot-gitlab> gitlab # [  296.139904] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa5a45b348f8970d3ee17e13","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa5a45b348f8970d3ee17e13: start","job_status":"start","queue_duration_s":1.647086,"scheduling_latency_s":1.647104}1590vm-test-run-nixbot-gitlab> gitlab # [  296.152481] sidekiq-cluster[2065]: {"severity":"INFO","time":"2026-08-20T05:51:07.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa5a45b348f8970d3ee17e13","created_at":"2026-08-20T05:51:05.569Z","trace_propagation_headers":{"sentry-trace":"3b587670ed8f4598b42c546322c908e7-4e26ab7badde4a6a","baggage":"sentry-trace_id=3b587670ed8f4598b42c546322c908e7,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"59b8ef52219ff0576b7c9166b34bfe3a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:51:05.645Z","job_size_bytes":2,"pid":2065,"sidekiq_tid":"m7ot","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa5a45b348f8970d3ee17e13: done: 0.015607 sec","job_status":"done","queue_duration_s":1.647086,"scheduling_latency_s":1.647104,"redis_calls":13,"redis_duration_s":0.001565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011191,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015607,"completed_at":"2026-08-20T05:51:07.308Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591vm-test-run-nixbot-gitlab> gitlab # [  309.188923] redis[788]: 10 changes in 300 seconds. Saving...1592vm-test-run-nixbot-gitlab> gitlab # [  309.194431] redis[788]: Background saving started by pid 33681593vm-test-run-nixbot-gitlab> gitlab # [  309.202367] redis[3368]: BGSAVE done, 506 keys saved, 0 keys skipped, 127245 bytes written.1594vm-test-run-nixbot-gitlab> gitlab # [  309.206949] redis[3368]: DB saved on disk1595vm-test-run-nixbot-gitlab> gitlab # [  309.209273] redis[3368]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1596vm-test-run-nixbot-gitlab> gitlab # [  309.290051] redis[788]: Background saving terminated with success1597vm-test-run-nixbot-gitlab> gitlab # [  311.006204] postgres[863]: [863] LOG:  checkpoint starting: time