tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab: QEMU running (pid 46) gitlab # Formatting '/build/vm-state-gitlab/tmp.6vj8alGizL', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab # Discarding device blocks: 0/262144 done gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab # Filesystem UUID: a5f83a47-6b2d-4aab-8b11-48b9a65a1b66 gitlab # Superblock backups stored on blocks: (finished: start all VMs, in 75.38 seconds) gitlab # 32768, 98304, 163840, 229376 gitlab: waiting for unit setup-gitlab.service gitlab # gitlab: waiting for the VM to finish booting gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] KASLR enabled gitlab # [ 0.000000] random: crng init done gitlab # [ 0.000000] Machine model: linux,dummy-virt gitlab # [ 0.000000] efi: UEFI not found. gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf] gitlab # [ 0.000000] Zone ranges: gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff] gitlab # [ 0.000000] DMA32 empty gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.000000] Device empty gitlab # [ 0.000000] Movable zone start for each node gitlab # [ 0.000000] Early memory node ranges gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe000000 gitlab # [ 0.000000] psci: probing for conduit method from DT. gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware. gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs gitlab # [ 0.000000] psci: Trusted OS migration not required gitlab # [ 0.000000] psci: SMC Calling Convention v1.1 gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 gitlab # [ 0.000000] Detected PIPT I-cache on CPU0 gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface gitlab # [ 0.000000] CPU features: detected: Spectre-v4 gitlab # [ 0.000000] CPU features: detected: Spectre-BHB gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 gitlab # [ 0.000000] alternatives: applying boot alternatives gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/7b006a2xf3kpadjydwjh1pvd159x0wjc-nixos-system-gitlab-test/init regInfo=/nix/store/xif5y6hkrdq84wna17p85b1psfk9msxb-closure-info/registration console=ttyAMA0,115200n8 console=tty0 gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/xif5y6hkrdq84wna17p85b1psfk9msxb-closure-info/registration", will be passed to user space. gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.000000] software IO TLB: area num 4. gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB) gitlab # [ 0.000000] Fallback order for Node 0: 0 gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1572864 gitlab # [ 0.000000] Policy zone: Normal gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.000000] allocated 12582912 bytes of page_ext gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups gitlab # [ 0.000000] rcu: Hierarchical RCU implementation. gitlab # [ 0.000000] rcu: RCU event tracing is enabled. gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.000000] Rude variant of Tasks RCU enabled. gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled. gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 gitlab # [ 0.000000] GICv3: 256 SPIs implemented gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f40000 gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f50000 gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns gitlab # [ 0.000028] arm-pv: using stolen time PV gitlab # [ 0.000373] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.000563] Console: colour dummy device 80x25 gitlab # [ 0.000570] printk: legacy console [tty0] enabled gitlab # [ 0.000752] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) gitlab # [ 0.000758] pid_max: default: 32768 minimum: 301 gitlab # [ 0.000846] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.000984] landlock: Up and running. gitlab # [ 0.000987] Yama: becoming mindful. gitlab # [ 0.001411] LSM support for eBPF active gitlab # [ 0.001609] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.001719] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.002911] cacheinfo: Unable to detect cache hierarchy for CPU 0 gitlab # [ 0.003621] rcu: Hierarchical SRCU implementation. gitlab # [ 0.003625] rcu: Max phase no-delay instances is 1000. gitlab # [ 0.003782] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.004846] fsl-mc MSI: its@8080000 domain created gitlab # [ 0.004941] EFI services will not be available. gitlab # [ 0.005098] smp: Bringing up secondary CPUs ... gitlab # [ 0.005744] Detected PIPT I-cache on CPU1 gitlab # [ 0.005840] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000 gitlab # [ 0.005971] GICv3: CPU1: using allocated LPI pending table @0x0000000100f60000 gitlab # [ 0.006101] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40] gitlab # [ 0.007228] Detected PIPT I-cache on CPU2 gitlab # [ 0.007339] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000 gitlab # [ 0.007471] GICv3: CPU2: using allocated LPI pending table @0x0000000100f70000 gitlab # [ 0.007600] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40] gitlab # [ 0.008755] Detected PIPT I-cache on CPU3 gitlab # [ 0.008874] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000 gitlab # [ 0.009008] GICv3: CPU3: using allocated LPI pending table @0x0000000100f80000 gitlab # [ 0.009136] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40] gitlab # [ 0.009622] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.009649] SMP: Total of 4 processors activated. gitlab # [ 0.009652] CPU: All CPU(s) started at EL1 gitlab # [ 0.009660] CPU features: detected: Branch Target Identification gitlab # [ 0.009663] CPU features: detected: ARMv8.4 Translation Table Level gitlab # [ 0.009666] CPU features: detected: Instruction cache invalidation not required for I/D coherence gitlab # [ 0.009670] CPU features: detected: Data cache clean to the PoU not required for I/D coherence gitlab # [ 0.009673] CPU features: detected: Common not Private translations gitlab # [ 0.009676] CPU features: detected: CRC32 instructions gitlab # [ 0.009678] CPU features: detected: Data cache clean to Point of Deep Persistence gitlab # [ 0.009681] CPU features: detected: Data cache clean to Point of Persistence gitlab # [ 0.009684] CPU features: detected: Data independent timing control (DIT) gitlab # [ 0.009687] CPU features: detected: E0PD gitlab # [ 0.009689] CPU features: detected: Enhanced Counter Virtualization gitlab # [ 0.009692] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) gitlab # [ 0.009695] CPU features: detected: Enhanced Virtualization Traps gitlab # [ 0.009697] CPU features: detected: Fine Grained Traps gitlab # [ 0.009700] CPU features: detected: Generic authentication (architected QARMA5 algorithm) gitlab # [ 0.009704] CPU features: detected: RCpc load-acquire (LDAPR) gitlab # [ 0.009707] CPU features: detected: LSE atomic instructions gitlab # [ 0.009709] CPU features: detected: Privileged Access Never gitlab # [ 0.009712] CPU features: detected: PMUv3 gitlab # [ 0.009714] CPU features: detected: RAS Extension Support gitlab # [ 0.009716] CPU features: detected: RASv1p1 Extension Support gitlab # [ 0.009719] CPU features: detected: Random Number Generator gitlab # [ 0.009721] CPU features: detected: Speculation barrier (SB) gitlab # [ 0.009724] CPU features: detected: Stage-2 Force Write-Back gitlab # [ 0.009726] CPU features: detected: TLB range maintenance instructions gitlab # [ 0.009730] CPU features: detected: Speculative Store Bypassing Safe (SSBS) gitlab # [ 0.009870] alternatives: applying system-wide alternatives gitlab # [ 0.012853] CPU features: detected: BBM Level 2 without TLB conflict abort gitlab # [ 0.013048] Memory: 5963764K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved) gitlab # [ 0.014528] devtmpfs: initialized gitlab # [ 0.018500] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.018569] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.018783] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL gitlab # [ 0.018788] 0 pages in range for non-PLT usage gitlab # [ 0.018789] 508288 pages in range for PLT usage gitlab # [ 0.018878] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.019659] DMI not present or invalid. gitlab # [ 0.022896] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.025532] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.025806] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.027637] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.027666] audit: initializing netlink subsys (disabled) gitlab # [ 0.027972] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.028474] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.028478] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.028482] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.028485] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.028487] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.028584] cpuidle: using governor ladder gitlab # [ 0.028647] cpuidle: using governor menu gitlab # [ 0.028846] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. gitlab # [ 0.029066] ASID allocator initialised with 65536 entries gitlab # [ 0.030195] Serial: AMBA PL011 UART driver gitlab # [ 0.035350] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 gitlab # [ 0.035692] printk: console [ttyAMA0] enabled gitlab # [ 0.047511] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.047534] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.047544] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages gitlab # [ 0.047552] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page gitlab # [ 0.047560] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.047568] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.047576] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages gitlab # [ 0.047584] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page gitlab # [ 0.059256] fbcon: Taking over console gitlab # [ 0.059268] ACPI: Interpreter disabled. gitlab # [ 0.060282] iommu: Default domain type: Translated gitlab # [ 0.060287] iommu: DMA domain TLB invalidation policy: strict mode gitlab # [ 0.069214] SCSI subsystem initialized gitlab # [ 0.070484] usbcore: registered new interface driver usbfs gitlab # [ 0.070621] usbcore: registered new interface driver hub gitlab # [ 0.070699] usbcore: registered new device driver usb gitlab # [ 0.071626] pps_core: LinuxPPS API ver. 1 registered gitlab # [ 0.071638] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti gitlab # [ 0.071680] PTP clock support registered gitlab # [ 0.071849] EDAC MC: Ver: 3.0.0 gitlab # [ 0.072393] scmi_core: SCMI protocol bus registered gitlab # [ 0.073292] FPGA manager framework gitlab # [ 0.075765] vgaarb: loaded gitlab # [ 0.077107] clocksource: Switched to clocksource arch_sys_counter gitlab # [ 0.077586] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.077610] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.081861] netfs: FS-Cache loaded gitlab # [ 0.082296] pnp: PnP ACPI: disabled gitlab # [ 0.091211] NET: Registered PF_INET protocol family gitlab # [ 0.092378] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.124770] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.124823] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.124867] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.125209] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.125758] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.125860] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.125923] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.126036] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.126242] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.126259] NET: Registered PF_XDP protocol family gitlab # [ 0.126276] PCI: CLS 0 bytes, default 64 gitlab # [ 0.126652] Trying to unpack rootfs image as initramfs... gitlab # [ 0.141492] kvm [1]: HYP mode not available gitlab # [ 0.188279] Initialise system trusted keyrings gitlab # [ 0.189348] workingset: timestamp_bits=42 max_order=21 bucket_order=0 gitlab # [ 0.191489] squashfs: version 4.0 (2009/01/31) Phillip Lougher gitlab # [ 0.191715] 9p: Installing v9fs 9p2000 file system support gitlab # [ 0.230392] Key type asymmetric registered gitlab # [ 0.230405] Asymmetric key parser 'x509' registered gitlab # [ 0.230664] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) gitlab # [ 0.231054] io scheduler mq-deadline registered gitlab # [ 0.231071] io scheduler kyber registered gitlab # [ 0.241989] pl061_gpio 9030000.pl061: PL061 GPIO chip registered gitlab # [ 0.245446] ledtrig-cpu: registered to indicate activity on CPUs gitlab # [ 0.246219] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: gitlab # [ 0.246247] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 gitlab # [ 0.246287] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 gitlab # [ 0.246300] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 gitlab # [ 0.246348] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits gitlab # [ 0.246387] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] gitlab # [ 0.246524] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 gitlab # [ 0.246554] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.246564] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] gitlab # [ 0.246571] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] gitlab # [ 0.246578] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] gitlab # [ 0.246715] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.247749] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.248193] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.248221] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.248280] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.248316] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.249481] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.249926] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.249953] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.250013] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.251096] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.251539] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.251565] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.251624] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.252721] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.253187] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.253214] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.253272] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.254315] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.254764] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.254798] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.254856] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.256005] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.256442] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.256468] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.256526] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.257623] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.258044] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.258070] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.258128] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.258155] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.259240] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint gitlab # [ 0.259712] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.259770] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.260883] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.261349] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.261408] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.262378] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint gitlab # [ 0.262817] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] gitlab # [ 0.263407] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.263951] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] gitlab # [ 0.263978] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.264036] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.265171] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.265596] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.265634] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.265692] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.266965] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned gitlab # [ 0.266978] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned gitlab # [ 0.266986] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned gitlab # [ 0.267080] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned gitlab # [ 0.267170] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned gitlab # [ 0.267262] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned gitlab # [ 0.267351] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned gitlab # [ 0.267445] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned gitlab # [ 0.267535] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned gitlab # [ 0.267625] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned gitlab # [ 0.267727] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned gitlab # [ 0.267819] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned gitlab # [ 0.267935] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned gitlab # [ 0.268038] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned gitlab # [ 0.268076] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned gitlab # [ 0.268112] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned gitlab # [ 0.268149] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned gitlab # [ 0.268185] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned gitlab # [ 0.268221] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned gitlab # [ 0.268266] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned gitlab # [ 0.268303] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned gitlab # [ 0.268349] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned gitlab # [ 0.268387] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned gitlab # [ 0.268424] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned gitlab # [ 0.268462] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned gitlab # [ 0.268498] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned gitlab # [ 0.268534] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned gitlab # [ 0.268570] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned gitlab # [ 0.268605] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned gitlab # [ 0.268642] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned gitlab # [ 0.268685] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned gitlab # [ 0.268721] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned gitlab # [ 0.268758] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned gitlab # [ 0.268795] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned gitlab # [ 0.268847] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] gitlab # [ 0.268858] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] gitlab # [ 0.268864] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] gitlab # [ 0.271638] pci 0000:00:0a.0: enabling device (0000 -> 0002) gitlab # [ 0.305239] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) gitlab # [ 0.311184] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) gitlab # [ 0.317389] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) gitlab # [ 0.323855] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) gitlab # [ 0.329980] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) gitlab # [ 0.336655] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) gitlab # [ 0.342917] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) gitlab # [ 0.350200] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) gitlab # [ 0.355961] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) gitlab # [ 0.362149] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) gitlab # [ 0.368020] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) gitlab # [ 0.383365] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.388318] msm_serial: driver initialized gitlab # [ 0.388722] SuperH (H)SCI(F) driver initialized gitlab # [ 0.388848] STM32 USART driver initialized gitlab # [ 0.426799] loop: module loaded gitlab # [ 0.427227] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 0.430374] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 0.433238] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 0.435869] virtio_blk virtio5: [vdb] 12284328 512-byte logical blocks (6.29 GB/5.86 GiB) gitlab # [ 0.438984] megasas: 07.734.00.00-rc1 gitlab # [ 0.440173] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] gitlab # [ 0.443262] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.443284] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.446167] Using buffer write method gitlab # [ 0.446235] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] gitlab # [ 0.449079] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.449100] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.452637] Using buffer write method gitlab # [ 0.452657] Concatenating MTD devices: gitlab # [ 0.452661] (0): "0.flash" gitlab # [ 0.452664] (1): "0.flash" gitlab # [ 0.452667] into device "0.flash" gitlab # [ 0.578090] Freeing initrd memory: 27184K gitlab # [ 0.596498] tun: Universal TUN/TAP device driver, 1.6 gitlab # [ 0.605684] thunder_xcv, ver 1.0 gitlab # [ 0.605799] thunder_bgx, ver 1.0 gitlab # [ 0.605862] nicpf, ver 1.0 gitlab # [ 0.607552] e1000: Intel(R) PRO/1000 Network Driver gitlab # [ 0.607564] e1000: Copyright (c) 1999-2006 Intel Corporation. gitlab # [ 0.607640] e1000e: Intel(R) PRO/1000 Network Driver gitlab # [ 0.607757] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. gitlab # [ 0.607854] igb: Intel(R) Gigabit Ethernet Network Driver gitlab # [ 0.607864] igb: Copyright (c) 2007-2014 Intel Corporation. gitlab # [ 0.607928] igbvf: Intel(R) Gigabit Virtual Function Network Driver gitlab # [ 0.607938] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. gitlab # [ 0.608367] sky2: driver version 1.30 gitlab # [ 0.612734] ehci-pci 0000:00:0a.0: EHCI Host Controller gitlab # [ 0.612769] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 gitlab # [ 0.613022] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 gitlab # [ 0.613331] usbcore: registered new interface driver usb-storage gitlab # [ 0.613956] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.613999] usbserial: USB Serial support registered for generic gitlab # [ 0.615907] hv_vmbus: registering driver hyperv_keyboard gitlab # [ 0.618504] rtc-pl031 9010000.pl031: registered as rtc0 gitlab # [ 0.618561] rtc-pl031 9010000.pl031: setting system clock to 2026-09-04T07:23:45 UTC (1788506625) gitlab # [ 0.619530] i2c_dev: i2c /dev entries driver gitlab # [ 0.621165] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 gitlab # [ 0.621802] hub 1-0:1.0: USB hub found gitlab # [ 0.621845] hub 1-0:1.0: 6 ports detected gitlab # [ 0.628081] sdhci: Secure Digital Host Controller Interface driver gitlab # [ 0.628097] sdhci: Copyright(c) Pierre Ossman gitlab # [ 0.628902] Synopsys Designware Multimedia Card Interface Driver gitlab # [ 0.630102] sdhci-pltfm: SDHCI platform and OF driver helper gitlab # [ 0.634877] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 0.635781] usbcore: registered new interface driver usbhid gitlab # [ 0.635792] usbhid: USB HID core driver gitlab # [ 0.646445] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available gitlab # [ 0.650813] drop_monitor: Initializing network drop monitor service gitlab # [ 0.651170] NET: Registered PF_INET6 protocol family gitlab # [ 0.653262] Segment Routing with IPv6 gitlab # [ 0.653294] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.653391] NET: Registered PF_PACKET protocol family gitlab # [ 0.653742] 9pnet: Installing 9P2000 support gitlab # [ 0.657241] Key type dns_resolver registered gitlab # [ 0.670060] registered taskstats version 1 gitlab # [ 0.670368] Loading compiled-in X.509 certificates gitlab # [ 0.685856] Demotion targets for Node 0: null gitlab # [ 0.686103] Key type .fscrypt registered gitlab # [ 0.686110] Key type fscrypt-provisioning registered gitlab # [ 0.686281] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 0.686303] ima: Allocated hash algorithm: sha1 gitlab # [ 0.686337] ima: No architecture policies found gitlab # [ 0.687496] input: gpio-keys as /devices/platform/gpio-keys/input/input0 gitlab # [ 0.712383] clk: Disabling unused clocks gitlab # [ 0.712410] PM: genpd: Disabling unused power domains gitlab # [ 0.717207] Freeing unused kernel memory: 4736K gitlab # [ 0.717427] Run /init as init process gitlab # [ 0.760831] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 0.869206] usb 1-1: new high-speed USB device number 2 using ehci-pci gitlab # [ 1.023732] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 gitlab # [ 1.095767] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.095839] systemd[1]: Detected virtualization qemu. gitlab # [ 1.095912] systemd[1]: Detected architecture arm64. gitlab # [ 1.095928] systemd[1]: Running in initrd. gitlab # [ 1.096757] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.097183] systemd[1]: Hostname set to . gitlab # [ 1.125889] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 gitlab # [ 1.245190] usb 1-2: new high-speed USB device number 3 using ehci-pci gitlab # [ 1.317557] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.395228] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 gitlab # [ 1.395691] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 gitlab # [ 1.398711] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.420408] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.420715] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.420757] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.420773] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.420803] systemd[1]: Reached target Path Units. gitlab # [ 1.420822] systemd[1]: Reached target Slice Units. gitlab # [ 1.420844] systemd[1]: Reached target Swaps. gitlab # [ 1.420865] systemd[1]: Reached target Timer Units. gitlab # [ 1.421055] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.421349] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.421575] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.421742] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.421839] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.421861] systemd[1]: Reached target Socket Units. gitlab # [ 1.423940] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.425955] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.426034] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 1.428039] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 1.456849] systemd[1]: Starting Journal Service... gitlab # [ 1.458695] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.458792] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.460196] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 1.466209] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 1.467197] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.467536] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.467836] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 1.469609] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 1.506234] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 1.512613] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 gitlab # [ 1.512851] [drm] features: -virgl +edid -resource_blob -host_visible gitlab # [ 1.512872] [drm] features: -context_init gitlab # [ 1.513391] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.513615] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 1.514049] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 1.515795] [drm] number of scanouts: 1 gitlab # [ 1.515818] [drm] number of cap sets: 0 gitlab # [ 1.516388] systemd-journald[95]: Collecting audit messages is disabled. gitlab # [ 1.526060] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic gitlab # [ 1.526099] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 gitlab # [ 1.538578] Console: switching to colour frame buffer device 160x50 gitlab # [ 1.547235] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device gitlab # [ 1.559181] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.559880] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.560316] systemd[1]: Reached target Local File Systems. gitlab # [ 1.569534] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.571036] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.574620] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.605703] systemd[1]: Started Journal Service. gitlab # [ 1.602622] systemd-modules-load[96]: Using 4 probe threads gitlab # [ 1.604893] systemd-modules-load[96]: Module 'virtio_balloon' is built in gitlab # [ 1.607550] systemd-modules-load[96]: Module 'virtio_console' is built in gitlab # [ 1.610236] systemd-modules-load[96]: Module 'virtio_rng' is built in gitlab # [ 1.611789] systemd-modules-load[96]: Inserted module 'dm_mod' gitlab # [ 1.614967] systemd-modules-load[96]: Inserted module 'virtio_gpu' gitlab # [ 1.616494] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.629483] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.646599] systemd-udevd[105]: Using default interface naming scheme 'v261'. gitlab # [ 1.650158] systemd[1]: Finished Create System Files and Directories. gitlab # [ 1.663468] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 1.691391] systemd[1]: Starting Virtual Console Setup... gitlab # [ 1.790254] systemd-vconsole-setup[128]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 1.795468] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.063054] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.065769] systemd[1]: Reached target System Initialization. gitlab # [ 2.068301] systemd[1]: Reached target Basic System. gitlab # [ 2.224826] (udev-worker)[120]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.252162] (udev-worker)[144]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.258104] (udev-worker)[144]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.293948] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.300951] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.302607] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.317506] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.349438] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.355451] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.458190] systemd[1]: Mounting /sysroot... gitlab # [ 2.494956] EXT4-fs (vda): mounted filesystem a5f83a47-6b2d-4aab-8b11-48b9a65a1b66 r/w with ordered data mode. Quota mode: none. gitlab # [ 2.491866] systemd[1]: Mounted /sysroot. gitlab # [ 2.493722] systemd[1]: Reached target Initrd Root File System. gitlab # [ 2.496455] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 2.500209] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 2.518482] systemd[1]: Mounting /sysroot/run... gitlab # [ 2.521613] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 2.527162] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 2.534342] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 2.548386] systemd-sysroot-fstab-check[165]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 2.550064] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 2.551342] systemd[1]: Mounted /sysroot/run. gitlab # [ 2.563940] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 2.565823] systemd[1]: Reload requested from client PID 165 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 2.567410] systemd[1]: Reloading... gitlab # [ 2.791770] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 2.846118] (udev-worker)[126]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory gitlab # [ 2.848631] (udev-worker)[126]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory gitlab # [ 2.851757] systemd[1]: Reloading finished in 279 ms. gitlab # [ 2.900044] systemd-sysroot-fstab-check[165]: Requesting initrd-fs.target/start/replace... gitlab # [ 2.903593] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 2.904964] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 2.906213] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 2.907424] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 2.909368] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 2.910791] systemd-sysroot-fstab-check[165]: Requesting swap.target/start/replace... gitlab # [ 2.918957] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 2.920789] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 2.922486] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 2.928800] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 2.931652] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 2.933115] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 2.934063] systemd[1]: Stopping Virtual Console Setup... gitlab # [ 2.935052] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.973419] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 2.976713] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 2.990982] systemd-vconsole-setup[197]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.994605] systemd[1]: Finished Virtual Console Setup. gitlab # [ 3.463628] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.538679] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.541024] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.543444] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.546118] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.592555] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.596149] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.613133] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.615423] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.618015] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 3.685180] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 3.687826] systemd[1]: Stopped target Basic System. gitlab # [ 3.690244] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 3.692724] systemd[1]: Stopped target Path Units. gitlab # [ 3.694850] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 3.698166] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 3.701724] systemd[1]: Stopped target Slice Units. gitlab # [ 3.703889] systemd[1]: Stopped target Socket Units. gitlab # [ 3.707944] systemd[1]: Stopped target System Initialization. gitlab # [ 3.710867] systemd[1]: Stopped target Swaps. gitlab # [ 3.712965] systemd[1]: Stopped target Timer Units. gitlab # [ 3.715132] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 3.717560] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 3.719858] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 3.724548] systemd[1]: Stopped Find NixOS closure. gitlab # [ 3.732435] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 3.735659] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.739298] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 3.742373] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 3.745213] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 3.747877] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 3.749844] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 3.752621] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 3.755272] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 3.757887] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 3.759881] systemd[1]: Stopped target Local File Systems. gitlab # [ 3.761692] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 3.763702] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 3.766035] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 3.767573] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 3.769661] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.771604] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.773093] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 3.774866] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 3.776649] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 3.778559] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 3.780234] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.782142] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.783721] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 3.785607] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 3.787545] systemd[1]: systemd-udevd.service: Consumed 2.265s CPU time over 2.190s wall clock time, 31.7M memory peak. gitlab # [ 3.791585] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 3.793849] systemd[1]: Closed udev Control Socket. gitlab # [ 3.795239] systemd[1]: Starting Cleanup udev Database... gitlab # [ 3.796805] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 3.798862] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 3.800573] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 3.802713] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 3.804665] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 3.806490] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 3.864912] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 3.868157] systemd[1]: Finished Cleanup udev Database. gitlab # [ 3.870456] systemd[1]: Reached target Switch Root. gitlab # [ 3.872860] systemd[1]: Starting NixOS Activation... gitlab # [ 4.068300] initrd-nixos-activation-start[226]: booting system configuration /nix/store/7b006a2xf3kpadjydwjh1pvd159x0wjc-nixos-system-gitlab-test gitlab # [ 4.134130] initrd-nixos-activation-start[226]: running activation script... gitlab # [ 4.513117] initrd-nixos-activation-start[249]: setting up /etc... gitlab # [ 4.691835] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.695635] systemd[1]: Finished NixOS Activation. gitlab # [ 4.698015] systemd[1]: Starting Switch Root... gitlab # [ 4.755273] systemd[1]: Switching root. gitlab # [ 4.882369] systemd-journald[95]: Received SIGTERM from PID 1 (systemd). gitlab # [ 5.551446] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.551624] systemd[1]: Detected virtualization qemu. gitlab # [ 5.551709] systemd[1]: Detected architecture arm64. gitlab # [ 5.551895] systemd[1]: Detected first boot. gitlab # [ 5.553380] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.824553] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.957775] systemd[1]: Applying preset policy. gitlab # [ 6.186744] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 6.359049] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 6.359533] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 6.364423] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 6.371579] systemd[1]: Created slice Slice /system/getty. gitlab # [ 6.375666] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 6.379791] systemd[1]: Created slice User and Session Slice. gitlab # [ 6.381389] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 6.382895] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 6.384146] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 6.385397] systemd[1]: Expecting device /dev/ttyAMA0... gitlab # [ 6.386579] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 6.387794] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 6.388950] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 6.390101] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 6.391291] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 6.392518] systemd[1]: Reached target Path Units. gitlab # [ 6.393694] systemd[1]: Reached target Remote File Systems. gitlab # [ 6.394816] systemd[1]: Reached target Slice Units. gitlab # [ 6.395983] systemd[1]: Reached target Swaps. gitlab # [ 6.400207] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 6.404727] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 6.408053] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 6.411976] systemd[1]: Listening on Factory Reset Management. gitlab # [ 6.413522] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 6.423017] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 6.425707] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 6.430434] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 6.432522] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 6.433855] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.435021] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 6.441138] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 6.442481] systemd[1]: Listening on udev Control Socket. gitlab # [ 6.443850] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 6.486808] systemd[1]: Mounting Huge Pages File System... gitlab # [ 6.492770] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 6.499654] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 6.505665] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 6.512402] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 6.523777] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 6.525166] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 6.537516] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.545384] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 6.545954] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.555565] systemd[1]: Starting Load Kernel Module fuse... gitlab # [ 6.556786] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.571045] systemd[1]: Starting Journal Service... gitlab # [ 6.577671] systemd[1]: Starting Load Kernel Modules... gitlab # [ 6.585412] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 6.603768] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 6.604399] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.614467] systemd-journald[320]: Collecting audit messages is enabled. gitlab # [ 6.620530] fuse: init (API version 7.45) gitlab # [ 6.621344] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 6.628362] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 6.629351] systemd[1]: Mounted Huge Pages File System. gitlab # [ 6.630241] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 6.625077] systemd[1]: Queued start job for default target Multi-User System.[ 6.631013] systemd[1]: Started Journal Service. gitlab # gitlab # [ 6.635670] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 6.637015] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 6.638421] systemd-modules-load[321]: Using 3 probe threads gitlab # [ 6.639590] systemd-modules-load[321]: Module 'atkbd' is built in gitlab # [ 6.640832] systemd-modules-load[321]: Module 'loop' is built in gitlab # [ 6.641942] systemd-modules-load[321]: Inserted module 'tls' gitlab # [ 6.643030] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 6.644117] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 6.645178] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 6.646373] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 6.647690] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 6.648887] systemd[1]: Mounted Kernel Configuration File System.[ 6.654829] EXT4-fs (vda): re-mounted a5f83a47-6b2d-4aab-8b11-48b9a65a1b66. gitlab # gitlab # [ 6.653441] systemd[1]: modprobe@fuse.service: Deactivated successfully. gitlab # [ 6.654466] systemd[1]: Finished Load Kernel Module fuse. gitlab # [ 6.655326] systemd[1]: Finished Load Kernel Modules. gitlab # [ 6.656147] systemd[1]: Mounting FUSE Control File System... gitlab # [ 6.657029] systemd[1]: Starting Firewall... gitlab # [ 6.676109] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 6.677560] systemd-oomd[323]: No swap; memory pressure usage will be degraded gitlab # [ 6.680468] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 6.687260] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 6.689058] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 6.691079] systemd[1]: Mounted FUSE Control File System. gitlab # [ 6.697469] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 6.703020] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 6.704535] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.712699] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.713889] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.725369] systemd-journald[320]: Received client request to flush runtime journal. gitlab # [ 6.752357] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 6.756877] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.758874] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.760812] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 6.762718] systemd[1]: Reached target First Boot Complete. gitlab # [ 6.764046] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 6.765434] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 6.766815] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 6.768376] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 6.845724] systemd-udevd[373]: Using default interface naming scheme 'v261'. gitlab # [ 6.902983] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 7.113085] systemd[1]: Finished Firewall. gitlab # [ 7.279487] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 7.380295] systemd[1]: Mounting /run/wrappers... gitlab # [ 7.381725] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 7.421242] systemd[1]: Mounted /run/wrappers. gitlab # [ 7.422438] systemd[1]: Reached target Local File Systems. gitlab # [ 7.423794] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 7.426849] systemd[1]: Starting register-nix-paths.service... gitlab # [ 7.435260] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 7.438212] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.467876] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 7.469951] systemd[1]: Starting Create System Files and Directories... gitlab # [ 7.480294] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 7.518566] (udev-worker)[427]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 7.524206] (udev-worker)[427]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.527240] (udev-worker)[431]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.536326] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 7.543481] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 7.544946] systemd[1]: Finished Create System Files and Directories. gitlab # [ 7.546035] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. gitlab # [ 7.551471] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 7.568261] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 7.579586] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 7.581701] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 7.583581] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.585155] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 7.590196] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 7.592712] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.594115] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.596284] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 7.597999] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 7.611712] systemd[1]: Starting Update is Completed... gitlab # [ 7.634518] systemd[1]: Finished Update is Completed. gitlab # [ 7.676456] mousedev: PS/2 mouse device common for all mice gitlab # [ 7.706041] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 7.707435] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.708572] systemd[1]: suid-sgid-wrappers.service: Consumed 162ms CPU time over 271ms wall clock time, 6.1M memory peak, 1.9M read from disk. gitlab # [ 8.101267] systemd[1]: Finished register-nix-paths.service. gitlab # [ 8.108640] systemd[1]: Reached target System Initialization. gitlab # [ 8.109599] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 8.110622] systemd[1]: Started logrotate.timer. gitlab # [ 8.111333] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 8.112356] systemd[1]: Reached target Timer Units. gitlab # [ 8.125397] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 8.132692] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 8.142849] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 gitlab # [ 8.147386] systemd[1]: Starting nixbot CI service socket... gitlab # [ 8.151724] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 8.158572] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 8.159553] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 8.160757] systemd[1]: Reached target Socket Units. gitlab # [ 8.199682] systemd[1]: Starting Virtual Console Setup... gitlab # [ 8.210061] dbus-broker-launch[566]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 8.211564] dbus-broker-launch[566]: NSS returned no entry for 'systemd-timesync' gitlab # [ 8.213133] dbus-broker-launch[566]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 8.215413] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 8.229631] dbus-broker-launch[566]: Ready gitlab # [ 8.230933] systemd[1]: Reached target Basic System. gitlab # [ 8.233220] systemd[1]: Started backdoor.service. gitlab # [ 8.235633] systemd[1]: Starting gitlab-config.service... gitlab # [ 8.239176] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 8.251895] systemd[1]: Starting Logrotate configuration check... gitlab # [ 8.255263] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # connecting to host... gitlab # [ 8.260525] systemd[1]: Starting Post-Boot Actions... gitlab # [ 8.262708] systemd[1]: Started Reset console on configuration changes. gitlab # [ 8.275288] systemd[1]: Starting resolvconf update... gitlab # [ 8.287103] logrotate[576]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 8.292233] logrotate[576]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf gitlab # [ 8.293791] logrotate[576]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 8.294748] logrotate[576]: Reading state from file: /var/lib/logrotate.status gitlab # [ 8.295668] logrotate[576]: state file /var/lib/logrotate.status does not exist gitlab # [ 8.298050] logrotate[576]: Allocating hash table for state file, size 64 entries gitlab # [ 8.299035] logrotate[576]: Handling 4 logs gitlab: connected to guest root shell gitlab # [ 8.299582] logrotate[576]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab: (connecting took 8.77 seconds) gitlab # [ 8.306836] logrotate[576]: considering log /var/log/btmp gitlab: (finished: waiting for the VM to finish booting, in 8.77 seconds) gitlab # [ 8.307579] logrotate[576]: Creating new state gitlab # [ 8.308197] logrotate[576]: Now: 2026-09-04 07:23 gitlab # [ 8.308803] logrotate[576]: Last rotated at 2026-09-04 07:00 gitlab # [ 8.309506] logrotate[576]: log does not need rotating (log has already been rotated) gitlab # [ 8.310930] logrotate[576]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 8.312989] logrotate[576]: considering log /var/log/wtmp gitlab # [ 8.313690] logrotate[576]: Creating new state gitlab # [ 8.314253] logrotate[576]: Now: 2026-09-04 07:23 gitlab # [ 8.314867] logrotate[576]: Last rotated at 2026-09-04 07:00 gitlab # [ 8.315567] logrotate[576]: log does not need rotating (log has already been rotated) gitlab # [ 8.316959] logrotate[576]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 8.318677] logrotate[576]: switching euid from 0 to 165 and egid from 0 to 165 (pid 576) gitlab # [ 8.319684] logrotate[576]: considering log /var/gitlab/state/log/*.log gitlab # [ 8.320531] logrotate[576]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 8.322419] logrotate[576]: Creating new state gitlab # [ 8.323016] logrotate[576]: switching euid from 165 to 0 and egid from 165 to 0 (pid 576) gitlab # [ 8.324305] logrotate[576]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 8.326056] logrotate[576]: switching euid from 0 to 60 and egid from 0 to 60 (pid 576) gitlab # [ 8.327717] logrotate[576]: considering log /var/log/nginx/*.log gitlab # [ 8.328803] logrotate[576]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 8.329967] logrotate[576]: Creating new state gitlab # [ 8.331038] logrotate[576]: not running postrotate script, since no logs were rotated gitlab # [ 8.332165] logrotate[576]: switching euid from 60 to 0 and egid from 60 to 0 (pid 576) gitlab # [ 8.333551] systemd-vconsole-setup[570]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 8.335711] nsncd[579]: Sep 04 07:23:53.191 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.338177] systemd[1]: Finished Virtual Console Setup. gitlab # [ 8.339195] systemd[1]: Finished Logrotate configuration check. gitlab # [ 8.341188] systemd[1]: Finished Post-Boot Actions. gitlab # [ 8.342374] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.343407] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.344528] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.345399] systemd[1]: Starting User Login Management... gitlab # [ 8.346214] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 8.368366] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 8.370163] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 8.371729] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 8.374982] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 8.379273] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 8.381701] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 8.385690] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 8.387374] systemd[1]: nscd.service: Consumed 24ms CPU time over 118ms wall clock time, 7.3M memory peak, 5.8M read from disk. gitlab # [ 8.389601] systemd-logind[622]: New seat seat0. gitlab # [ 8.390388] systemd-logind[622]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 8.391699] systemd-logind[622]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) gitlab # [ 8.393058] systemd-logind[622]: Watching system buttons on /dev/input/event0 (gpio-keys) gitlab # [ 8.394200] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 8.395092] systemd[1]: Started User Login Management. gitlab # [ 8.402815] systemd[1]: Starting linger-users.service... gitlab # [ 8.410444] systemd[1]: Finished resolvconf update. gitlab # [ 8.414111] systemd[1]: Reached target Preparation for Network. gitlab # [ 8.420045] systemd[1]: Starting DHCP Client... gitlab # [ 8.421082] systemd[1]: Starting Address configuration of eth1... gitlab # [ 8.427617] nsncd[671]: Sep 04 07:23:53.313 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.432667] systemd[1]: Starting Extra networking commands.... gitlab # [ 8.433931] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.435625] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 8.436765] systemd[1]: Finished linger-users.service. gitlab # [ 8.440264] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.441299] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.459926] network-addresses-eth1-start[684]: adding address 192.168.1.1/24... done gitlab # [ 8.468162] network-addresses-eth1-start[684]: adding address 2001:db8:1::1/64... done gitlab # [ 8.477809] systemd[1]: Finished Address configuration of eth1. gitlab # [ 8.513393] dhcpcd[710]: dhcpcd-10.3.2 starting gitlab # [ 8.516632] dhcpcd[759]: dev: loaded udev gitlab # [ 8.517381] systemd[1]: Finished Extra networking commands.. gitlab # [ 8.518261] systemd[1]: Reached target Network. gitlab # [ 8.520250] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 8.523549] systemd[1]: Starting Nginx Web Server... gitlab # [ 8.534694] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 8.535089] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 8.532214] systemd[1]: Starting PostgreSQL Server... gitlab # [ 8.537313] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 8.541533] systemd[1]: Starting Permit User Sessions... gitlab # [ 8.558658] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 8.578655] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 8.579114] systemd[1]: Finished Permit User Sessions. gitlab # [ 8.589511] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 8.590042] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 8.592025] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 8.584981] systemd[1]: Started Getty on tty1.[ 8.592370] cfg80211: failed to load regulatory.db gitlab # gitlab # [ 8.591838] systemd[1]: Reached target Login Prompts. gitlab # [ 8.652304] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 8.648724] dhcpcd[759]: eth0: waiting for carrier gitlab # [ 8.650947] dhcpcd[759]: eth0: carrier acquired gitlab # [ 8.656316] dhcpcd[759]: DUID 00:01:00:01:32:2d:2e:89:52:54:00:12:34:56 gitlab # [ 8.657336] dhcpcd[759]: eth0: IAID 00:12:34:56 gitlab # [ 8.657973] dhcpcd[759]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 8.739744] nginx-pre-start[796]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok gitlab # [ 8.742923] nginx-pre-start[796]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful gitlab # [ 8.746431] systemd[1]: Started Nginx Web Server. gitlab # [ 8.754600] redis-server[791]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 8.757528] redis-server[791]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 8.758800] redis-server[791]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=791, just started gitlab # [ 8.760574] redis-server[791]: Configuration loaded gitlab # [ 8.761613] redis[791]: monotonic clock: ARM CNTVCT @ 1000 ticks/us gitlab # [ 8.762898] redis[791]: Running mode=standalone, port=0. gitlab # [ 8.764213] redis[791]: Server initialized gitlab # [ 8.765298] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 8.766423] redis[791]: Ready to accept connections unix gitlab # [ 8.767682] redis[791]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 8.770814] postgresql-pre-start[797]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 8.772825] postgresql-pre-start[797]: This user must also own the server process. gitlab # [ 8.774181] postgresql-pre-start[797]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 8.775685] postgresql-pre-start[797]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 8.777424] postgresql-pre-start[797]: The default text search configuration will be set to "english". gitlab # [ 8.778882] postgresql-pre-start[797]: Data page checksums are enabled. gitlab # [ 8.779862] postgresql-pre-start[797]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 8.781396] postgresql-pre-start[797]: creating subdirectories ... ok gitlab # [ 8.782343] postgresql-pre-start[797]: selecting dynamic shared memory implementation ... posix gitlab # [ 8.792122] dhcpcd[759]: eth0: soliciting a DHCP lease gitlab # [ 8.801200] dhcpcd[759]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 8.816259] dhcpcd[759]: eth0: probing address 10.0.2.15/24 gitlab # [ 8.820235] postgresql-pre-start[797]: selecting default "max_connections" ... 100 gitlab # [ 8.871627] postgresql-pre-start[797]: selecting default "shared_buffers" ... 128MB gitlab # [ 9.191390] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 9.392619] postgresql-pre-start[797]: selecting default time zone ... UTC gitlab # [ 9.396317] postgresql-pre-start[797]: creating configuration files ... ok gitlab # [ 9.643531] postgresql-pre-start[797]: running bootstrap script ... ok gitlab # [ 9.703988] gitlab-workhorse[820]: time="2026-09-04T07:23:54Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 9.709764] gitlab-workhorse[820]: time="2026-09-04T07:23:54Z" level=info msg="Using redis/go-redis" gitlab # [ 9.711125] gitlab-workhorse[820]: time="2026-09-04T07:23:54Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 10.345067] postgresql-pre-start[797]: performing post-bootstrap initialization ... ok gitlab # [ 10.641910] postgresql-pre-start[797]: syncing data to disk ... ok gitlab # [ 10.644805] postgresql-pre-start[797]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 10.648773] postgresql-pre-start[797]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 10.655466] postgresql-pre-start[797]: Success. You can now start the database server using: gitlab # [ 10.659127] postgresql-pre-start[797]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 10.851468] postgres[855]: [855] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 10.857291] postgres[855]: [855] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 10.860766] postgres[855]: [855] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 10.864582] postgres[855]: [855] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 10.874503] postgres[864]: [864] LOG: database system was shut down at 2026-09-04 07:23:55 GMT gitlab # [ 10.894554] postgres[855]: [855] LOG: database system is ready to accept connections gitlab # [ 10.900123] systemd[1]: Started PostgreSQL Server. gitlab # [ 10.905786] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 10.943352] dhcpcd[759]: eth0: soliciting an IPv6 router gitlab # [ 10.944317] dhcpcd[759]: eth0: Router Advertisement from fe80::2 gitlab # [ 10.946270] dhcpcd[759]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 10.947426] dhcpcd[759]: eth0: adding route to fec0::/64 gitlab # [ 10.948291] dhcpcd[759]: eth0: adding default route via fe80::2 gitlab # [ 11.343035] postgresql-setup-start[875]: CREATE DATABASE gitlab # [ 11.394573] postgresql-setup-start[880]: CREATE ROLE gitlab # [ 11.417791] postgresql-setup-start[882]: ALTER DATABASE gitlab # [ 11.462557] postgresql-setup-start[887]: CREATE ROLE gitlab # [ 11.466368] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 11.467718] systemd[1]: Reached target PostgreSQL. gitlab # [ 11.471985] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 11.670101] gitlab-postgresql-start[900]: CREATE DATABASE gitlab # [ 11.745923] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[894]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 11.750684] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[894]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 11.758857] gitlab-postgresql-start[913]: CREATE EXTENSION gitlab # [ 11.838657] systemd[1]: Finished gitlab-config.service. gitlab # [ 11.843389] systemd[1]: Started gitaly.service. gitlab # [ 11.848150] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 11.985816] gitlab-postgresql-start[917]: CREATE EXTENSION gitlab # [ 11.992237] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 12.916918] gitaly[930]: time="2026-09-04T07:23:57.802Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=930 gitlab # [ 12.917244] gitaly[930]: time="2026-09-04T07:23:57.802Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=930 gitlab # [ 12.917364] gitaly[930]: time="2026-09-04T07:23:57.802Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=930 gitlab # [ 12.917465] gitaly[930]: time="2026-09-04T07:23:57.802Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=930 gitlab # [ 12.917564] gitaly[930]: time="2026-09-04T07:23:57.802Z" level=info msg="Starting Gitaly" pid=930 version= gitlab # [ 13.199646] gitaly[930]: time="2026-09-04T07:23:58.085Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=282 pid=930 gitlab # [ 13.204093] gitaly[930]: time="2026-09-04T07:23:58.086Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=930 gitlab # [ 13.208102] gitaly[930]: time="2026-09-04T07:23:58.086Z" level=info msg="finished initializing command factory" duration_ms=0 pid=930 gitlab # [ 13.212362] gitaly[930]: time="2026-09-04T07:23:58.086Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-930/git-exec-1601150996.d/git pid=930 gitlab # [ 13.217099] gitaly[930]: time="2026-09-04T07:23:58.095Z" level=info msg="finished detecting git version" duration_ms=9 pid=930 gitlab # [ 13.220826] gitaly[930]: time="2026-09-04T07:23:58.095Z" level=info msg="using Git version" pid=930 version=2.53.g gitlab # [ 13.224468] gitaly[930]: time="2026-09-04T07:23:58.095Z" level=info msg="clearing disk cache object folder" pid=930 storage=default gitlab # [ 13.228626] gitaly[930]: time="2026-09-04T07:23:58.096Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2754999733 pid=930 storage=default gitlab # [ 13.235063] gitaly[930]: time="2026-09-04T07:23:58.096Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2754999733 pid=930 storage=default gitlab # [ 13.242130] gitaly[930]: time="2026-09-04T07:23:58.096Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=930 gitlab # [ 13.248538] gitaly[930]: time="2026-09-04T07:23:58.096Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=930 gitlab # [ 13.254607] gitaly[930]: time="2026-09-04T07:23:58.096Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache2754999733 clear_duration_ms=0 pid=930 storage=default gitlab # [ 13.260819] gitaly[930]: time="2026-09-04T07:23:58.116Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=930 gitlab # [ 13.265758] gitaly[930]: time="2026-09-04T07:23:58.117Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=930 schema=unix gitlab # [ 13.270838] gitaly[930]: time="2026-09-04T07:23:58.117Z" level=info msg="listening at address" address=/run/gitaly/gitaly-930/sock.d/intern pid=930 schema=unix gitlab # [ 13.275204] gitaly[930]: time="2026-09-04T07:23:58.117Z" level=info msg="finished tempdir cleaner walk" pid=930 storage=default time_ms=0 gitlab # [ 13.279392] gitaly[930]: time="2026-09-04T07:23:58.118Z" level=info msg="counting repositories" pid=930 gitlab # [ 13.282332] gitaly[930]: time="2026-09-04T07:23:58.118Z" level=info msg="starting to count repositories" pid=930 storage_path=/var/gitlab/state/repositories gitlab # [ 13.286494] gitaly[930]: time="2026-09-04T07:23:58.118Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=930 storage_path=/var/gitlab/state/repositories gitlab # [ 13.291168] gitaly[930]: time="2026-09-04T07:23:58.118Z" level=info msg="completed counting all repositories" counting_duration=0 pid=930 gitlab # [ 13.294603] gitaly[930]: time="2026-09-04T07:23:58.119Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=930 gitlab # [ 13.297900] gitaly[930]: time="2026-09-04T07:23:58.120Z" level=info msg="Started Gitaly" duration_ms=317 pid=930 gitlab # [ 13.300978] gitaly[930]: time="2026-09-04T07:23:58.120Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=930 gitlab # [ 13.304491] gitaly[930]: time="2026-09-04T07:23:58.120Z" level=info msg="maintenance: daily scheduled" pid=930 scheduled="2026-09-04 12:00:00 +0000 UTC" gitlab # [ 13.693843] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[933]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 13.702750] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[933]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 13.721143] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[933]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 14.495650] dhcpcd[759]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 14.495886] dhcpcd[759]: eth0: adding route to 10.0.2.0/24 gitlab # [ 14.496043] dhcpcd[759]: eth0: adding default route via 10.0.2.2 gitlab # [ 14.697665] systemd[1]: Started DHCP Client. gitlab # [ 14.700870] systemd[1]: Reached target Network is Online. gitlab # [ 16.886180] gitaly[930]: time="2026-09-04T07:24:01.771Z" level=info msg="License database preloaded" duration_ms=3968 pid=930 gitlab # [ 59.405508] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[933]: W, [2026-09-04T07:24:44.290265 #933] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 59.761567] gitlab-workhorse[820]: time="2026-09-04T07:24:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 62.669556] postgres[1448]: [1448] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 62.669941] postgres[1448]: [1448] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 62.670091] postgres[1448]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 62.670215] postgres[1448]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 62.670333] postgres[1448]: attidentity AS identity, gitlab # [ 62.670450] postgres[1448]: attgenerated as attgenerated gitlab # [ 62.670566] postgres[1448]: FROM pg_attribute a gitlab # [ 62.670684] postgres[1448]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 62.670804] postgres[1448]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 62.670934] postgres[1448]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 62.671051] postgres[1448]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 62.671169] postgres[1448]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 62.671284] postgres[1448]: ORDER BY a.attnum gitlab # [ 62.671400] postgres[1448]: gitlab # [ 69.028466] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1508]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 69.034595] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1508]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 69.765222] gitlab-workhorse[820]: time="2026-09-04T07:24:54Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 79.774771] gitlab-workhorse[820]: time="2026-09-04T07:25:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 89.782260] gitlab-workhorse[820]: time="2026-09-04T07:25:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 95.922204] postgres[1620]: [1620] ERROR: relation "table_without_models" does not exist gitlab # [ 95.922728] postgres[1620]: [1620] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 99.783347] gitlab-workhorse[820]: time="2026-09-04T07:25:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 109.784638] gitlab-workhorse[820]: time="2026-09-04T07:25:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 119.785863] gitlab-workhorse[820]: time="2026-09-04T07:25:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 129.457346] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 129.461388] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 129.465000] systemd[1]: Starting gitlab.service... gitlab # [ 129.788248] gitlab-workhorse[820]: time="2026-09-04T07:25:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 130.060625] bundle[2022]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 130.062767] bundle[2022]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 130.070602] bundle[2022]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 134.907829] sidekiq-cluster[2021]: {"severity":"INFO","time":"2026-09-04T07:25:59.760Z","message":"Starting cluster with 1 processes"} gitlab # [ 135.179419] bundle[2022]: {"timestamp":"2026-09-04T07:26:00.031Z","pid":2022,"message":"* Enabling systemd notification integration"} gitlab # [ 135.184515] bundle[2022]: {"timestamp":"2026-09-04T07:26:00.064Z","pid":2022,"message":"Puma starting in cluster mode..."} gitlab # [ 135.188932] bundle[2022]: {"timestamp":"2026-09-04T07:26:00.064Z","pid":2022,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 135.193663] bundle[2022]: {"timestamp":"2026-09-04T07:26:00.064Z","pid":2022,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 135.199486] bundle[2022]: {"timestamp":"2026-09-04T07:26:00.064Z","pid":2022,"message":"* Min threads: 0"} gitlab # [ 135.203551] bundle[2022]: {"timestamp":"2026-09-04T07:26:00.064Z","pid":2022,"message":"* Max threads: 4"} gitlab # [ 135.207496] bundle[2022]: {"timestamp":"2026-09-04T07:26:00.064Z","pid":2022,"message":"* Environment: production"} gitlab # [ 135.211836] bundle[2022]: {"timestamp":"2026-09-04T07:26:00.064Z","pid":2022,"message":"* Master PID: 2022"} gitlab # [ 135.215890] bundle[2022]: {"timestamp":"2026-09-04T07:26:00.064Z","pid":2022,"message":"* Workers: 2"} gitlab # [ 135.219848] bundle[2022]: {"timestamp":"2026-09-04T07:26:00.065Z","pid":2022,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 135.224941] bundle[2022]: {"timestamp":"2026-09-04T07:26:00.065Z","pid":2022,"message":"* Preloading application"} gitlab # [ 139.799802] gitlab-workhorse[820]: time="2026-09-04T07:26:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 149.810288] gitlab-workhorse[820]: time="2026-09-04T07:26:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 159.811490] gitlab-workhorse[820]: time="2026-09-04T07:26:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 169.821871] gitlab-workhorse[820]: time="2026-09-04T07:26:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 177.340558] bundle[2022]: W, [2026-09-04T07:26:42.225597 #2022] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 179.829823] gitlab-workhorse[820]: time="2026-09-04T07:26:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 182.068937] sidekiq-cluster[2072]: 2026-09-04T07:26:46.953Z pid=2072 tid=xps INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2072, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>426250240} gitlab # [ 182.406977] sidekiq-cluster[2072]: W, [2026-09-04T07:26:47.293126 #2072] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 182.571909] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:47.458Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 186.144464] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.029Z","message":"GitLab reliable fetch activated!"} gitlab # [ 186.144907] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.029Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 186.178678] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.065Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 186.185722] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.067Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 186.192816] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.070Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 186.199431] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.073Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 186.206939] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.076Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 186.213673] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.078Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 186.219862] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.080Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 186.225006] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.082Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 186.229597] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.084Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 186.234277] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.086Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 186.239206] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.088Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 186.243414] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.091Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 186.247089] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.093Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 186.250835] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.095Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 186.254351] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.097Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 186.257704] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.099Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 186.260698] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.102Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 186.263490] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.105Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 186.266644] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.108Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 186.269538] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.111Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 186.272532] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.113Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 186.275563] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.116Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 186.278271] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.118Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 186.280888] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.121Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 186.283417] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.123Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 186.285916] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.126Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 186.288191] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.129Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 186.290475] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.132Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 186.292825] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.136Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 186.295128] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.139Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 186.297361] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.142Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 186.299644] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.145Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 186.301833] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.148Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 186.304041] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.152Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 186.306190] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.154Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 186.308366] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.157Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 186.310534] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.159Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 186.312621] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.163Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 186.314694] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.165Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 186.316788] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.167Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 186.318985] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.170Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 186.321224] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.172Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 186.323406] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.175Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 186.325589] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.177Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 186.327801] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.180Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 186.330218] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.183Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 186.333735] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.186Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 186.335902] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.188Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 186.338162] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.192Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 186.340313] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.194Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 186.342404] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.197Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 186.344466] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.200Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 186.346514] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.213Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 186.348835] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.217Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 186.351044] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.220Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 186.353316] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.223Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 186.355477] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.225Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 186.357894] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.229Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 186.360104] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.231Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 186.362344] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.234Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 186.364396] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.236Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 186.366406] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.238Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 186.434539] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.319Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 186.438486] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.324Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 186.442579] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.327Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 186.446534] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.330Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 186.450302] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.334Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 186.454232] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.336Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 186.458386] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.339Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 186.462543] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.341Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 186.466462] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.344Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 186.470456] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.346Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 186.474340] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.350Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 186.478353] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.352Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 186.482131] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.354Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 186.485782] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.358Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 186.489067] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.360Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 186.492573] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.364Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 186.495570] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.366Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 186.498547] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.369Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 186.501666] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.371Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 186.504764] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.374Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 186.507588] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.377Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 186.510365] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.380Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 186.513191] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.383Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 186.515713] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.386Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 186.518513] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.389Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 186.521109] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.391Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 186.523595] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.394Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 186.526191] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.397Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 186.528696] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.399Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 186.531077] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.401Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 186.534691] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.403Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 186.537251] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.405Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 186.539473] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.409Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 186.542206] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.412Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 186.544745] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.415Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 186.547200] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.417Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 186.553769] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.440Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 186.557575] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.444Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 186.560431] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.446Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 186.564060] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.450Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 186.566808] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.453Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 186.570273] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.456Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 186.573302] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.459Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 186.579857] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.464Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 186.582870] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.466Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 186.585742] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.471Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 186.588732] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:26:51.475Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 189.841131] gitlab-workhorse[820]: time="2026-09-04T07:26:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 199.846918] gitlab-workhorse[820]: time="2026-09-04T07:27:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 209.857904] gitlab-workhorse[820]: time="2026-09-04T07:27:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 219.866584] gitlab-workhorse[820]: time="2026-09-04T07:27:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 229.876759] gitlab-workhorse[820]: time="2026-09-04T07:27:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 235.555294] postgres[2908]: [2908] ERROR: relation "table_without_models" does not exist gitlab # [ 235.555735] postgres[2908]: [2908] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 239.886817] gitlab-workhorse[820]: time="2026-09-04T07:27:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 241.560940] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:27:46.446Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 241.564864] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:27:46.451Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 241.568337] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:27:46.453Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 241.570397] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:27:46.453Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 241.580376] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:27:46.460Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 241.646738] postgres[2965]: [2965] ERROR: relation "table_without_models" does not exist gitlab # [ 241.649075] postgres[2965]: [2965] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 245.019659] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:27:49.904Z","message":"Cleaning working queues"} gitlab # [ 245.025535] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:27:49.911Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"9d47ee1c69a091d2beb5ad75","created_at":"2026-09-04T07:25:53.611Z","trace_propagation_headers":{"sentry-trace":"9e5dba55987141469cae5828f8755902-05af6ee218ba4ebc","baggage":"sentry-trace_id=9e5dba55987141469cae5828f8755902,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ad336162feef206de429d3679583d06d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:25:53.623Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-9d47ee1c69a091d2beb5ad75: start","job_status":"start","queue_duration_s":116.288081,"scheduling_latency_s":116.288154} gitlab # [ 245.377662] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:27:50.262Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"9d47ee1c69a091d2beb5ad75","created_at":"2026-09-04T07:25:53.611Z","trace_propagation_headers":{"sentry-trace":"9e5dba55987141469cae5828f8755902-05af6ee218ba4ebc","baggage":"sentry-trace_id=9e5dba55987141469cae5828f8755902,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ad336162feef206de429d3679583d06d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-04T07:25:53.623Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-9d47ee1c69a091d2beb5ad75: done: 0.351572 sec","job_status":"done","queue_duration_s":116.288081,"scheduling_latency_s":116.288154,"redis_calls":29,"redis_duration_s":0.0144,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.008725,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003593,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002082,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.167808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.18682870000000001,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.351572,"completed_at":"2026-09-04T07:27:50.262Z","load_balancing_strategy":"primary","db_duration_s":0.118914,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 249.889529] gitlab-workhorse[820]: time="2026-09-04T07:27:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 250.563977] bundle[2022]: {"timestamp":"2026-09-04T07:27:55.449Z","pid":2022,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 250.569954] bundle[2022]: {"timestamp":"2026-09-04T07:27:55.449Z","pid":2022,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 250.575325] bundle[2022]: {"timestamp":"2026-09-04T07:27:55.449Z","pid":2022,"message":"! #\u003cThread:0x0000e1a4bf4ab3c0 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 250.591253] bundle[2022]: {"timestamp":"2026-09-04T07:27:55.449Z","pid":2022,"message":"! #\u003cThread:0x0000e1a4bf6c0ef8 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 250.607086] bundle[2022]: {"timestamp":"2026-09-04T07:27:55.449Z","pid":2022,"message":"Use Ctrl-C to stop"} gitlab # [ 250.610615] bundle[2022]: {"timestamp":"2026-09-04T07:27:55.450Z","pid":2022,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 254.671909] bundle[2022]: {"timestamp":"2026-09-04T07:27:59.557Z","pid":2022,"message":"- Worker 0 (PID: 3100) booted in 4.07s, phase: 0"} gitlab # [ 254.674025] bundle[2022]: {"timestamp":"2026-09-04T07:27:59.557Z","pid":2022,"message":"- Worker 1 (PID: 3104) booted in 4.03s, phase: 0"} gitlab # [ 254.678705] systemd[1]: Started gitlab.service. gitlab # [ 254.679551] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 254.687233] systemd[1]: Starting setup-gitlab.service... gitlab # [ 254.720678] setup-gitlab-start[3165]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 256.015015] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:28:00 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 1244 gitlab # [ 256.020383] setup-gitlab-start[3165]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 256.021157] setup-gitlab-start[3165]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 256.043451] runuser[3179]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 256.744731] setup-gitlab-start[3180]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 256.751606] setup-gitlab-start[3180]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 256.758495] setup-gitlab-start[3180]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 257.486564] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:02.371Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"6ff388f398a563a8eb0c9333","created_at":"2026-09-04T07:28:02.275Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc5ca120884a9ee6a72dab3ae47510a0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.367Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-6ff388f398a563a8eb0c9333: start","job_status":"start","queue_duration_s":0.004012,"scheduling_latency_s":0.004062} gitlab # [ 257.737074] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:02.621Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"6ff388f398a563a8eb0c9333","created_at":"2026-09-04T07:28:02.275Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bc5ca120884a9ee6a72dab3ae47510a0","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.367Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-6ff388f398a563a8eb0c9333: done: 0.250792 sec","job_status":"done","queue_duration_s":0.004012,"scheduling_latency_s":0.004062,"redis_calls":12,"redis_duration_s":0.015972,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001041,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.009287,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.056578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00432814,"exclusive_lock_hold_duration_s":0.05617492,"duration_s":0.250792,"completed_at":"2026-09-04T07:28:02.621Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.096145,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.825660] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:02.693Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ce094439e634faf1a3f40096","created_at":"2026-09-04T07:28:02.388Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7d27b2df053907806e93f1401857993","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.421Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ce094439e634faf1a3f40096: start","job_status":"start","queue_duration_s":0.271385,"scheduling_latency_s":0.271454} gitlab # [ 257.845212] setup-gitlab-start[3180]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 257.847686] setup-gitlab-start[3180]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 257.850297] setup-gitlab-start[3180]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 258.074182] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:02.959Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"ce094439e634faf1a3f40096","created_at":"2026-09-04T07:28:02.388Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7d27b2df053907806e93f1401857993","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.421Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-ce094439e634faf1a3f40096: done: 0.26618 sec","job_status":"done","queue_duration_s":0.271385,"scheduling_latency_s":0.271454,"redis_calls":16,"redis_duration_s":0.045782,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.0243,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016996,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004486,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.062,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.062,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00495938,"duration_s":0.26618,"completed_at":"2026-09-04T07:28:02.958Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.070149,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.168240] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:02.968Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"837683f566ec0ce8f9821c82","created_at":"2026-09-04T07:28:02.430Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"676b43799921ee61368b70e0676cfb31","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.446Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-837683f566ec0ce8f9821c82: start","job_status":"start","queue_duration_s":0.521716,"scheduling_latency_s":0.521785} gitlab # [ 258.198414] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:03.083Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"837683f566ec0ce8f9821c82","created_at":"2026-09-04T07:28:02.430Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"676b43799921ee61368b70e0676cfb31","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.446Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-837683f566ec0ce8f9821c82: done: 0.116098 sec","job_status":"done","queue_duration_s":0.521716,"scheduling_latency_s":0.521785,"redis_calls":12,"redis_duration_s":0.020727,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002251,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.009999,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00277724,"exclusive_lock_hold_duration_s":0.01473268,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.116098,"completed_at":"2026-09-04T07:28:03.083Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014707,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.266192] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:03.130Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c9677151b6922d5cf42f5cdc","created_at":"2026-09-04T07:28:02.485Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7aba77826d7dd25ac9e9469909dc4bf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.515Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c9677151b6922d5cf42f5cdc: start","job_status":"start","queue_duration_s":0.614322,"scheduling_latency_s":0.61439} gitlab # [ 259.339011] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"c9677151b6922d5cf42f5cdc","created_at":"2026-09-04T07:28:02.485Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7aba77826d7dd25ac9e9469909dc4bf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.515Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-c9677151b6922d5cf42f5cdc: done: 1.093466 sec","job_status":"done","queue_duration_s":0.614322,"scheduling_latency_s":0.61439,"redis_calls":14,"redis_duration_s":0.028118,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.008648,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015417,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004053,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.179,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.179,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.565507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00234436,"exclusive_lock_hold_duration_s":0.9895545,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":1.093466,"completed_at":"2026-09-04T07:28:04.223Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.362197,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.444101] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.225Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"7d81c071661b042967ed8e35","created_at":"2026-09-04T07:28:02.541Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29ed2944c6d42e87b19cc2f4af14d7ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.568Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-7d81c071661b042967ed8e35: start","job_status":"start","queue_duration_s":1.656976,"scheduling_latency_s":1.657007} gitlab # [ 259.467951] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.243Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 259.473247] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.253Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"7d81c071661b042967ed8e35","created_at":"2026-09-04T07:28:02.541Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29ed2944c6d42e87b19cc2f4af14d7ad","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.568Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-7d81c071661b042967ed8e35: done: 0.027527 sec","job_status":"done","queue_duration_s":1.656976,"scheduling_latency_s":1.657007,"redis_calls":10,"redis_duration_s":0.003244,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000762,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001813,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000669,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045718,"duration_s":0.027527,"completed_at":"2026-09-04T07:28:04.253Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000957,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.522063] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.255Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"903e2b857f610ae3ab88700a","created_at":"2026-09-04T07:28:02.604Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"413c68a3f18bdc8abce9b28f98648f90","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:28:02.629Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-903e2b857f610ae3ab88700a: start","job_status":"start","queue_duration_s":1.62565,"scheduling_latency_s":1.625679} gitlab # [ 259.536181] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"903e2b857f610ae3ab88700a","created_at":"2026-09-04T07:28:02.604Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"413c68a3f18bdc8abce9b28f98648f90","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:28:02.629Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-903e2b857f610ae3ab88700a: done: 0.049038 sec","job_status":"done","queue_duration_s":1.62565,"scheduling_latency_s":1.625679,"redis_calls":10,"redis_duration_s":0.003558,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000728,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002103,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000727,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00059368,"duration_s":0.049038,"completed_at":"2026-09-04T07:28:04.304Z","load_balancing_strategy":"primary","db_duration_s":0.009237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.583522] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.306Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fd2d78c9633f917898d29e26","created_at":"2026-09-04T07:28:02.658Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a60a3b7ffbee15ac0a45fcf9dd73a3d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.671Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fd2d78c9633f917898d29e26: start","job_status":"start","queue_duration_s":1.634902,"scheduling_latency_s":1.634933} gitlab # [ 259.599612] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.324Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 259.603850] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.334Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fd2d78c9633f917898d29e26","created_at":"2026-09-04T07:28:02.658Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a60a3b7ffbee15ac0a45fcf9dd73a3d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.671Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fd2d78c9633f917898d29e26: done: 0.027329 sec","job_status":"done","queue_duration_s":1.634902,"scheduling_latency_s":1.634933,"redis_calls":10,"redis_duration_s":0.003091,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000712,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000645,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005437,"duration_s":0.027329,"completed_at":"2026-09-04T07:28:04.334Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.650035] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"50d00fbd847c2dbdfb60c352","created_at":"2026-09-04T07:28:02.686Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"533b5160ba0cc1b7163d7e00fc5757ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.703Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-50d00fbd847c2dbdfb60c352: start","job_status":"start","queue_duration_s":1.632776,"scheduling_latency_s":1.632805} gitlab # [ 259.664454] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.388Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"50d00fbd847c2dbdfb60c352","created_at":"2026-09-04T07:28:02.686Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"533b5160ba0cc1b7163d7e00fc5757ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.703Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-50d00fbd847c2dbdfb60c352: done: 0.052524 sec","job_status":"done","queue_duration_s":1.632776,"scheduling_latency_s":1.632805,"redis_calls":19,"redis_duration_s":0.006031,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001519,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000485,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002963,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041518,"duration_s":0.052524,"completed_at":"2026-09-04T07:28:04.388Z","load_balancing_strategy":"primary","db_duration_s":0.004221,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.710188] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.391Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"17306f922ff6c815a2591f8d","created_at":"2026-09-04T07:28:02.719Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee1dc09dc0ccd777d1cf9aff50b84404","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:28:02.735Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-17306f922ff6c815a2591f8d: start","job_status":"start","queue_duration_s":1.655932,"scheduling_latency_s":1.655961} gitlab # [ 259.724753] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.408Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 259.728823] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.417Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"17306f922ff6c815a2591f8d","created_at":"2026-09-04T07:28:02.719Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ee1dc09dc0ccd777d1cf9aff50b84404","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:28:02.735Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-17306f922ff6c815a2591f8d: done: 0.026915 sec","job_status":"done","queue_duration_s":1.655932,"scheduling_latency_s":1.655961,"redis_calls":10,"redis_duration_s":0.00316,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000699,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00184,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000621,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000422,"duration_s":0.026915,"completed_at":"2026-09-04T07:28:04.417Z","load_balancing_strategy":"primary","db_duration_s":0.00084,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.772870] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.420Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"4a9b902f356b4a6679fd5f63","created_at":"2026-09-04T07:28:02.769Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03e510b552607bca1a70bd498ff253ca","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.800Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-4a9b902f356b4a6679fd5f63: start","job_status":"start","queue_duration_s":1.619158,"scheduling_latency_s":1.619186} gitlab # [ 259.811411] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.697Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"4a9b902f356b4a6679fd5f63","created_at":"2026-09-04T07:28:02.769Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"03e510b552607bca1a70bd498ff253ca","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.800Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-4a9b902f356b4a6679fd5f63: done: 0.277098 sec","job_status":"done","queue_duration_s":1.619158,"scheduling_latency_s":1.619186,"redis_calls":12,"redis_duration_s":0.0064659999999999995,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001277,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001994,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003195,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.239783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00085362,"exclusive_lock_hold_duration_s":0.24637208,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.277098,"completed_at":"2026-09-04T07:28:04.697Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029592,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null} gitlab # [ 259.859182] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.699Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"378ce158153a2845ed331a73","created_at":"2026-09-04T07:28:02.837Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f87c915dcac8b8bc1d3664d44bd697e3","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.865Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-378ce158153a2845ed331a73: start","job_status":"start","queue_duration_s":1.834631,"scheduling_latency_s":1.834659} gitlab # [ 259.873328] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.731Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"378ce158153a2845ed331a73","created_at":"2026-09-04T07:28:02.837Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f87c915dcac8b8bc1d3664d44bd697e3","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.865Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-378ce158153a2845ed331a73: done: 0.031846 sec","job_status":"done","queue_duration_s":1.834631,"scheduling_latency_s":1.834659,"redis_calls":12,"redis_duration_s":0.004365,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000822,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000793,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000872,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004606,"duration_s":0.031846,"completed_at":"2026-09-04T07:28:04.731Z","load_balancing_strategy":"primary","db_duration_s":0.001261,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.916987] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.733Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"786881695e05fe128808cd83","created_at":"2026-09-04T07:28:02.896Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.922Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-786881695e05fe128808cd83: start","job_status":"start","queue_duration_s":1.811194,"scheduling_latency_s":1.811227} gitlab # [ 260.021163] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.906Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"786881695e05fe128808cd83","created_at":"2026-09-04T07:28:02.896Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:02.922Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-786881695e05fe128808cd83: done: 0.173004 sec","job_status":"done","queue_duration_s":1.811194,"scheduling_latency_s":1.811227,"redis_calls":71,"redis_duration_s":0.021074,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003462,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.015681,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.149663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039164,"duration_s":0.173004,"completed_at":"2026-09-04T07:28:04.906Z","load_balancing_strategy":"primary","db_duration_s":0.004013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.108725] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.909Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"86ac5acc5eff1c982cfc45e5","created_at":"2026-09-04T07:28:02.954Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fac5f858637ca335f5149ed2e26634a8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.011Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-86ac5acc5eff1c982cfc45e5: start","job_status":"start","queue_duration_s":1.89822,"scheduling_latency_s":1.898256} gitlab # [ 260.125899] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.960Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"86ac5acc5eff1c982cfc45e5","created_at":"2026-09-04T07:28:02.954Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fac5f858637ca335f5149ed2e26634a8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.011Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-86ac5acc5eff1c982cfc45e5: done: 0.051479 sec","job_status":"done","queue_duration_s":1.89822,"scheduling_latency_s":1.898256,"redis_calls":12,"redis_duration_s":0.006410000000000001,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000637,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001379,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004394,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0041817,"exclusive_lock_hold_duration_s":0.01369852,"duration_s":0.051479,"completed_at":"2026-09-04T07:28:04.960Z","load_balancing_strategy":"primary","db_duration_s":0.005802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.176057] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:04.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"207ce176b7392aefe3e541f2","created_at":"2026-09-04T07:28:03.041Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce7d4818f939e4d6f2d47ec8921be7fe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.079Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-207ce176b7392aefe3e541f2: start","job_status":"start","queue_duration_s":1.884171,"scheduling_latency_s":1.884209} gitlab # [ 260.191356] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.027Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"207ce176b7392aefe3e541f2","created_at":"2026-09-04T07:28:03.041Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce7d4818f939e4d6f2d47ec8921be7fe","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.079Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-207ce176b7392aefe3e541f2: done: 0.064673 sec","job_status":"done","queue_duration_s":1.884171,"scheduling_latency_s":1.884209,"redis_calls":12,"redis_duration_s":0.003462,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000591,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001483,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001388,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0012058,"exclusive_lock_hold_duration_s":0.02035368,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.064673,"completed_at":"2026-09-04T07:28:05.027Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.014944,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.237188] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.030Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ef8a1c3f8cea227951e1332f","created_at":"2026-09-04T07:28:03.122Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e902f4a4bc64f171d6620efb538f79b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.148Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ef8a1c3f8cea227951e1332f: start","job_status":"start","queue_duration_s":1.882094,"scheduling_latency_s":1.882128} gitlab # [ 260.251829] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.063Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"ef8a1c3f8cea227951e1332f","created_at":"2026-09-04T07:28:03.122Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e902f4a4bc64f171d6620efb538f79b","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.148Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-ef8a1c3f8cea227951e1332f: done: 0.032876 sec","job_status":"done","queue_duration_s":1.882094,"scheduling_latency_s":1.882128,"redis_calls":10,"redis_duration_s":0.00242,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000479,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001374,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000567,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003164,"duration_s":0.032876,"completed_at":"2026-09-04T07:28:05.062Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.296116] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.064Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d0c027fac2e27f6cb9ff4ddb","created_at":"2026-09-04T07:28:03.190Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b4d786cd7465e354681e3d419e65b34","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.231Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d0c027fac2e27f6cb9ff4ddb: start","job_status":"start","queue_duration_s":1.832805,"scheduling_latency_s":1.83283} gitlab # [ 260.311188] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.106Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"d0c027fac2e27f6cb9ff4ddb","created_at":"2026-09-04T07:28:03.190Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b4d786cd7465e354681e3d419e65b34","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.231Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-d0c027fac2e27f6cb9ff4ddb: done: 0.041945 sec","job_status":"done","queue_duration_s":1.832805,"scheduling_latency_s":1.83283,"redis_calls":13,"redis_duration_s":0.004452,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000676,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00219,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001586,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01303952,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.041945,"completed_at":"2026-09-04T07:28:05.106Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005245,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 260.357162] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.108Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2086fdff1203c6642ae679c7","created_at":"2026-09-04T07:28:03.296Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f84755b6ab0d6536f900c294596ac96e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.318Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2086fdff1203c6642ae679c7: start","job_status":"start","queue_duration_s":1.790162,"scheduling_latency_s":1.790191} gitlab # [ 260.371892] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.180Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"2086fdff1203c6642ae679c7","created_at":"2026-09-04T07:28:03.296Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f84755b6ab0d6536f900c294596ac96e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.318Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-2086fdff1203c6642ae679c7: done: 0.071694 sec","job_status":"done","queue_duration_s":1.790162,"scheduling_latency_s":1.790191,"redis_calls":14,"redis_duration_s":0.004992,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00135,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001991,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001651,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007426,"exclusive_lock_hold_duration_s":0.04035558,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.071694,"completed_at":"2026-09-04T07:28:05.180Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027341,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.416796] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.182Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"df800c082b405697b89add56","created_at":"2026-09-04T07:28:03.342Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4da8afe3fff3031fa39a20863825794b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.362Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-df800c082b405697b89add56: start","job_status":"start","queue_duration_s":1.820517,"scheduling_latency_s":1.820547} gitlab # [ 260.431685] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.212Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"df800c082b405697b89add56","created_at":"2026-09-04T07:28:03.342Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4da8afe3fff3031fa39a20863825794b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.362Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-df800c082b405697b89add56: done: 0.030122 sec","job_status":"done","queue_duration_s":1.820517,"scheduling_latency_s":1.820547,"redis_calls":12,"redis_duration_s":0.003793,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001455,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000605,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043784,"duration_s":0.030122,"completed_at":"2026-09-04T07:28:05.212Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001698,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.476351] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.215Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7e9fa01b427e15cb5cc5bce1","created_at":"2026-09-04T07:28:03.372Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbdc34157dc4e979bec8941d664f9ab9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:28:03.385Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7e9fa01b427e15cb5cc5bce1: start","job_status":"start","queue_duration_s":1.829479,"scheduling_latency_s":1.829508} gitlab # [ 260.489931] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.231Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 260.493355] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"7e9fa01b427e15cb5cc5bce1","created_at":"2026-09-04T07:28:03.372Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbdc34157dc4e979bec8941d664f9ab9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:28:03.385Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-7e9fa01b427e15cb5cc5bce1: done: 0.025464 sec","job_status":"done","queue_duration_s":1.829479,"scheduling_latency_s":1.829508,"redis_calls":10,"redis_duration_s":0.003317,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000714,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000663,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045046,"duration_s":0.025464,"completed_at":"2026-09-04T07:28:05.240Z","load_balancing_strategy":"primary","db_duration_s":0.000851,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.534002] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.243Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c7287461c643afc627f4f1c6","created_at":"2026-09-04T07:28:03.395Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4746158ca4857eaa460e8323a242301","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.407Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c7287461c643afc627f4f1c6: start","job_status":"start","queue_duration_s":1.836103,"scheduling_latency_s":1.836132} gitlab # [ 260.549048] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.259Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 260.552504] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c7287461c643afc627f4f1c6","created_at":"2026-09-04T07:28:03.395Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f4746158ca4857eaa460e8323a242301","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.407Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c7287461c643afc627f4f1c6: done: 0.025366 sec","job_status":"done","queue_duration_s":1.836103,"scheduling_latency_s":1.836132,"redis_calls":10,"redis_duration_s":0.003041,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000695,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001717,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000629,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043718,"duration_s":0.025366,"completed_at":"2026-09-04T07:28:05.268Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000877,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.596389] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.270Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"36aa6278a6223403c366b043","created_at":"2026-09-04T07:28:03.427Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2cdc1676f94fbe48b474fd2bf82b55a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.460Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-36aa6278a6223403c366b043: start","job_status":"start","queue_duration_s":1.809913,"scheduling_latency_s":1.80994} gitlab # [ 260.610783] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.332Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"36aa6278a6223403c366b043","created_at":"2026-09-04T07:28:03.427Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b2cdc1676f94fbe48b474fd2bf82b55a","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.460Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-36aa6278a6223403c366b043: done: 0.061982 sec","job_status":"done","queue_duration_s":1.809913,"scheduling_latency_s":1.80994,"redis_calls":10,"redis_duration_s":0.003633,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000629,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002237,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000767,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00064278,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.061982,"completed_at":"2026-09-04T07:28:05.332Z","load_balancing_strategy":"primary","db_duration_s":0.029641,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.656541] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.335Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"73fd6bc518bfcb41dc2fb09d","created_at":"2026-09-04T07:28:03.530Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"7553aa31473640f388fbd060a57168ac","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.556Z","job_size_bytes":3,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-73fd6bc518bfcb41dc2fb09d: start","job_status":"start","queue_duration_s":1.778748,"scheduling_latency_s":1.778784} gitlab # [ 260.670966] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.363Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"73fd6bc518bfcb41dc2fb09d","created_at":"2026-09-04T07:28:03.530Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"7553aa31473640f388fbd060a57168ac","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.556Z","job_size_bytes":3,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-73fd6bc518bfcb41dc2fb09d: done: 0.027685 sec","job_status":"done","queue_duration_s":1.778748,"scheduling_latency_s":1.778784,"redis_calls":10,"redis_duration_s":0.003303,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000761,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001795,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000747,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00041994,"duration_s":0.027685,"completed_at":"2026-09-04T07:28:05.363Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.714357] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:05.365Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1d8a903f465b8189e5b1ef9a","created_at":"2026-09-04T07:28:03.628Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3ef17ba83282120c7c65d2c9e8b0edc","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.661Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1d8a903f465b8189e5b1ef9a: start","job_status":"start","queue_duration_s":1.703889,"scheduling_latency_s":1.703917} gitlab # [ 261.127736] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.013Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"1d8a903f465b8189e5b1ef9a","created_at":"2026-09-04T07:28:03.628Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3ef17ba83282120c7c65d2c9e8b0edc","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.661Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-1d8a903f465b8189e5b1ef9a: done: 0.648347 sec","job_status":"done","queue_duration_s":1.703889,"scheduling_latency_s":1.703917,"redis_calls":565,"redis_duration_s":0.135103,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000713,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001711,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.132679,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.56511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050782,"duration_s":0.648347,"completed_at":"2026-09-04T07:28:06.013Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.224472] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.015Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"8d5d583f31584201bf7ca7e5","created_at":"2026-09-04T07:28:03.689Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47187f8c09b763ca7729327c2df5ed05","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.735Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-8d5d583f31584201bf7ca7e5: start","job_status":"start","queue_duration_s":2.280294,"scheduling_latency_s":2.280328} gitlab # [ 261.243079] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.047Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"8d5d583f31584201bf7ca7e5","created_at":"2026-09-04T07:28:03.689Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"47187f8c09b763ca7729327c2df5ed05","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.735Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-8d5d583f31584201bf7ca7e5: done: 0.031474 sec","job_status":"done","queue_duration_s":2.280294,"scheduling_latency_s":2.280328,"redis_calls":10,"redis_duration_s":0.003362,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000813,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001889,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00066,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045058,"duration_s":0.031474,"completed_at":"2026-09-04T07:28:06.047Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002459,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.300563] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.050Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"5ee9460f1f08d300887dc21b","created_at":"2026-09-04T07:28:03.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff6ecdc06a3f1d7ccc16dd10302da3ce","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.802Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-5ee9460f1f08d300887dc21b: start","job_status":"start","queue_duration_s":2.248041,"scheduling_latency_s":2.248073} gitlab # [ 261.344300] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.092Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"5ee9460f1f08d300887dc21b","created_at":"2026-09-04T07:28:03.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff6ecdc06a3f1d7ccc16dd10302da3ce","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.802Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-5ee9460f1f08d300887dc21b: done: 0.041772 sec","job_status":"done","queue_duration_s":2.248041,"scheduling_latency_s":2.248073,"redis_calls":10,"redis_duration_s":0.003186,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000664,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001904,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000618,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004045,"duration_s":0.041772,"completed_at":"2026-09-04T07:28:06.091Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007153,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.410785] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.094Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e03b69de226dd5e2223178bd","created_at":"2026-09-04T07:28:03.854Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb694d9d366dfe04312b0f831cc2fe11","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.883Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e03b69de226dd5e2223178bd: start","job_status":"start","queue_duration_s":2.210527,"scheduling_latency_s":2.210556} gitlab # [ 261.426718] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.109Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 261.430086] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.121Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"e03b69de226dd5e2223178bd","created_at":"2026-09-04T07:28:03.854Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fb694d9d366dfe04312b0f831cc2fe11","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:28:03.883Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-e03b69de226dd5e2223178bd: done: 0.027804 sec","job_status":"done","queue_duration_s":2.210527,"scheduling_latency_s":2.210556,"redis_calls":10,"redis_duration_s":0.003092,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000689,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00064,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045398,"duration_s":0.027804,"completed_at":"2026-09-04T07:28:06.121Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.473431] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.124Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e82dd47e26af2ac0172c06aa","created_at":"2026-09-04T07:28:04.360Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-a10c446546a54772","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"533b5160ba0cc1b7163d7e00fc5757ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.378Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e82dd47e26af2ac0172c06aa: start","job_status":"start","queue_duration_s":1.745481,"scheduling_latency_s":1.745512} gitlab # [ 261.486307] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.147Z","message":"No existing merge request to be cleaned up."} gitlab # [ 261.488069] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.169Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e82dd47e26af2ac0172c06aa","created_at":"2026-09-04T07:28:04.360Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-a10c446546a54772","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"533b5160ba0cc1b7163d7e00fc5757ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.378Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e82dd47e26af2ac0172c06aa: done: 0.045231 sec","job_status":"done","queue_duration_s":1.745481,"scheduling_latency_s":1.745512,"redis_calls":13,"redis_duration_s":0.00559,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000714,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001656,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00322,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047726,"duration_s":0.045231,"completed_at":"2026-09-04T07:28:06.169Z","load_balancing_strategy":"primary","db_duration_s":0.006999,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.529474] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.171Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6c6e986ce4cb8a68885fbbb8","created_at":"2026-09-04T07:28:04.360Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-a10c446546a54772","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"533b5160ba0cc1b7163d7e00fc5757ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.378Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6c6e986ce4cb8a68885fbbb8: start","job_status":"start","queue_duration_s":1.792775,"scheduling_latency_s":1.792803} gitlab # [ 261.542210] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.186Z","message":"No existing merge request to be cleaned up."} gitlab # [ 261.543927] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.202Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6c6e986ce4cb8a68885fbbb8","created_at":"2026-09-04T07:28:04.360Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-a10c446546a54772","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"533b5160ba0cc1b7163d7e00fc5757ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.378Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6c6e986ce4cb8a68885fbbb8: done: 0.031086 sec","job_status":"done","queue_duration_s":1.792775,"scheduling_latency_s":1.792803,"redis_calls":10,"redis_duration_s":0.003354,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001364,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00199,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031086,"completed_at":"2026-09-04T07:28:06.202Z","load_balancing_strategy":"primary","db_duration_s":0.003674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.583880] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.204Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"84aeb3a6665889b95c24a532","created_at":"2026-09-04T07:28:04.360Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-a10c446546a54772","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"533b5160ba0cc1b7163d7e00fc5757ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.378Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-84aeb3a6665889b95c24a532: start","job_status":"start","queue_duration_s":1.826044,"scheduling_latency_s":1.826078} gitlab # [ 261.596855] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.223Z","message":"No existing merge request to be cleaned up."} gitlab # [ 261.598525] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.238Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"84aeb3a6665889b95c24a532","created_at":"2026-09-04T07:28:04.360Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-a10c446546a54772","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"533b5160ba0cc1b7163d7e00fc5757ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.378Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-84aeb3a6665889b95c24a532: done: 0.034022 sec","job_status":"done","queue_duration_s":1.826044,"scheduling_latency_s":1.826078,"redis_calls":10,"redis_duration_s":0.002778,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001659,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034022,"completed_at":"2026-09-04T07:28:06.238Z","load_balancing_strategy":"primary","db_duration_s":0.002824,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.637165] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.242Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f904d0a810a3e9d061d28c8c","created_at":"2026-09-04T07:28:04.360Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-a10c446546a54772","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"533b5160ba0cc1b7163d7e00fc5757ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.378Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f904d0a810a3e9d061d28c8c: start","job_status":"start","queue_duration_s":1.863416,"scheduling_latency_s":1.863453} gitlab # [ 261.649821] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.260Z","message":"No existing merge request to be cleaned up."} gitlab # [ 261.651536] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.276Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"f904d0a810a3e9d061d28c8c","created_at":"2026-09-04T07:28:04.360Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-a10c446546a54772","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"533b5160ba0cc1b7163d7e00fc5757ae","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.378Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-f904d0a810a3e9d061d28c8c: done: 0.034448 sec","job_status":"done","queue_duration_s":1.863416,"scheduling_latency_s":1.863453,"redis_calls":10,"redis_duration_s":0.003718,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001784,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034448,"completed_at":"2026-09-04T07:28:06.276Z","load_balancing_strategy":"primary","db_duration_s":0.003038,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.692442] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"078a28ffee2d5d205d8f6b89","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-078a28ffee2d5d205d8f6b89: start","job_status":"start","queue_duration_s":1.385713,"scheduling_latency_s":1.38575} gitlab # [ 261.705252] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"078a28ffee2d5d205d8f6b89","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-078a28ffee2d5d205d8f6b89: done: 0.037337 sec","job_status":"done","queue_duration_s":1.385713,"scheduling_latency_s":1.38575,"redis_calls":16,"redis_duration_s":0.0051,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000719,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00156,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002821,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046444,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037337,"completed_at":"2026-09-04T07:28:06.316Z","load_balancing_strategy":"primary","db_duration_s":0.001149,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.747253] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f286ca3c8db9555a0df5a25e","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f286ca3c8db9555a0df5a25e: start","job_status":"start","queue_duration_s":1.425302,"scheduling_latency_s":1.425333} gitlab # [ 261.761011] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.342Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f286ca3c8db9555a0df5a25e","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f286ca3c8db9555a0df5a25e: done: 0.023528 sec","job_status":"done","queue_duration_s":1.425302,"scheduling_latency_s":1.425333,"redis_calls":13,"redis_duration_s":0.003437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001258,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002179,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023528,"completed_at":"2026-09-04T07:28:06.342Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.803189] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"742c0fde8c7d446b6acf530e","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-742c0fde8c7d446b6acf530e: start","job_status":"start","queue_duration_s":1.451333,"scheduling_latency_s":1.45137} gitlab # [ 261.816828] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"742c0fde8c7d446b6acf530e","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-742c0fde8c7d446b6acf530e: done: 0.025342 sec","job_status":"done","queue_duration_s":1.451333,"scheduling_latency_s":1.45137,"redis_calls":13,"redis_duration_s":0.0037080000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001279,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002429,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025342,"completed_at":"2026-09-04T07:28:06.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.858012] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44cfddd44860797af2fe6c01","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44cfddd44860797af2fe6c01: start","job_status":"start","queue_duration_s":1.478857,"scheduling_latency_s":1.478887} gitlab # [ 261.871905] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44cfddd44860797af2fe6c01","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44cfddd44860797af2fe6c01: done: 0.026105 sec","job_status":"done","queue_duration_s":1.478857,"scheduling_latency_s":1.478887,"redis_calls":13,"redis_duration_s":0.00354,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001284,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002256,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014807,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026105,"completed_at":"2026-09-04T07:28:06.398Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.912951] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"832d90ec61b7c2a55453265b","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-832d90ec61b7c2a55453265b: start","job_status":"start","queue_duration_s":1.507211,"scheduling_latency_s":1.507245} gitlab # [ 261.926137] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"832d90ec61b7c2a55453265b","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-832d90ec61b7c2a55453265b: done: 0.025175 sec","job_status":"done","queue_duration_s":1.507211,"scheduling_latency_s":1.507245,"redis_calls":13,"redis_duration_s":0.003695,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001317,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002378,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025175,"completed_at":"2026-09-04T07:28:06.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.967324] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b98f04015f4d0d87ec68f009","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b98f04015f4d0d87ec68f009: start","job_status":"start","queue_duration_s":1.534525,"scheduling_latency_s":1.534559} gitlab # [ 261.979923] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b98f04015f4d0d87ec68f009","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b98f04015f4d0d87ec68f009: done: 0.024555 sec","job_status":"done","queue_duration_s":1.534525,"scheduling_latency_s":1.534559,"redis_calls":13,"redis_duration_s":0.003582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001219,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002363,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024555,"completed_at":"2026-09-04T07:28:06.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.019520] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"924dbb95e02c846d84d078a5","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-924dbb95e02c846d84d078a5: start","job_status":"start","queue_duration_s":1.561224,"scheduling_latency_s":1.561259} gitlab # [ 262.032569] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"924dbb95e02c846d84d078a5","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-924dbb95e02c846d84d078a5: done: 0.026154 sec","job_status":"done","queue_duration_s":1.561224,"scheduling_latency_s":1.561259,"redis_calls":13,"redis_duration_s":0.00476,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001354,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003406,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026154,"completed_at":"2026-09-04T07:28:06.480Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.074296] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52a2382439b5e82262b7d7b3","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52a2382439b5e82262b7d7b3: start","job_status":"start","queue_duration_s":1.589693,"scheduling_latency_s":1.589726} gitlab # [ 262.087388] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52a2382439b5e82262b7d7b3","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52a2382439b5e82262b7d7b3: done: 0.019956 sec","job_status":"done","queue_duration_s":1.589693,"scheduling_latency_s":1.589726,"redis_calls":13,"redis_duration_s":0.002953,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019956,"completed_at":"2026-09-04T07:28:06.502Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.128366] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7766a0f5179bf0ce07de1966","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7766a0f5179bf0ce07de1966: start","job_status":"start","queue_duration_s":1.611415,"scheduling_latency_s":1.611437} gitlab # [ 262.140927] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7766a0f5179bf0ce07de1966","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7766a0f5179bf0ce07de1966: done: 0.019253 sec","job_status":"done","queue_duration_s":1.611415,"scheduling_latency_s":1.611437,"redis_calls":13,"redis_duration_s":0.003132,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001133,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019253,"completed_at":"2026-09-04T07:28:06.523Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.180685] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a10ec0a28f480f0ab0c3256","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a10ec0a28f480f0ab0c3256: start","job_status":"start","queue_duration_s":1.632427,"scheduling_latency_s":1.632454} gitlab # [ 262.193594] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0a10ec0a28f480f0ab0c3256","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0a10ec0a28f480f0ab0c3256: done: 0.018514 sec","job_status":"done","queue_duration_s":1.632427,"scheduling_latency_s":1.632454,"redis_calls":13,"redis_duration_s":0.003098,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002042,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018514,"completed_at":"2026-09-04T07:28:06.544Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.234601] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.546Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb2bf1f15b67344afff6d222","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb2bf1f15b67344afff6d222: start","job_status":"start","queue_duration_s":1.652689,"scheduling_latency_s":1.652713} gitlab # [ 262.247689] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb2bf1f15b67344afff6d222","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb2bf1f15b67344afff6d222: done: 0.019787 sec","job_status":"done","queue_duration_s":1.652689,"scheduling_latency_s":1.652713,"redis_calls":13,"redis_duration_s":0.003777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001643,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019787,"completed_at":"2026-09-04T07:28:06.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.290082] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4bd9e2847ead45cd79050d4","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4bd9e2847ead45cd79050d4: start","job_status":"start","queue_duration_s":1.674286,"scheduling_latency_s":1.674311} gitlab # [ 262.303035] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c4bd9e2847ead45cd79050d4","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c4bd9e2847ead45cd79050d4: done: 0.018796 sec","job_status":"done","queue_duration_s":1.674286,"scheduling_latency_s":1.674311,"redis_calls":13,"redis_duration_s":0.003131,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002039,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011193,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018796,"completed_at":"2026-09-04T07:28:06.586Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.344071] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0023a94a8198c91c2276cb05","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0023a94a8198c91c2276cb05: start","job_status":"start","queue_duration_s":1.694885,"scheduling_latency_s":1.694908} gitlab # [ 262.357146] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0023a94a8198c91c2276cb05","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0023a94a8198c91c2276cb05: done: 0.018504 sec","job_status":"done","queue_duration_s":1.694885,"scheduling_latency_s":1.694908,"redis_calls":13,"redis_duration_s":0.0031920000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018504,"completed_at":"2026-09-04T07:28:06.606Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.397876] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26fd68acc6ba0fa20a6c79f3","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26fd68acc6ba0fa20a6c79f3: start","job_status":"start","queue_duration_s":1.71519,"scheduling_latency_s":1.715215} gitlab # [ 262.411040] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26fd68acc6ba0fa20a6c79f3","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26fd68acc6ba0fa20a6c79f3: done: 0.017901 sec","job_status":"done","queue_duration_s":1.71519,"scheduling_latency_s":1.715215,"redis_calls":13,"redis_duration_s":0.0029649999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017901,"completed_at":"2026-09-04T07:28:06.626Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.452398] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"749e2b5fc81e9e3d747eac56","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-749e2b5fc81e9e3d747eac56: start","job_status":"start","queue_duration_s":1.734907,"scheduling_latency_s":1.734932} gitlab # [ 262.465411] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"749e2b5fc81e9e3d747eac56","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-749e2b5fc81e9e3d747eac56: done: 0.025527 sec","job_status":"done","queue_duration_s":1.734907,"scheduling_latency_s":1.734932,"redis_calls":13,"redis_duration_s":0.008473000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001288,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013019,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025527,"completed_at":"2026-09-04T07:28:06.653Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.507599] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cf3aaf4cf5d04947a2f98fe","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cf3aaf4cf5d04947a2f98fe: start","job_status":"start","queue_duration_s":1.76709,"scheduling_latency_s":1.767126} gitlab # [ 262.520756] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3cf3aaf4cf5d04947a2f98fe","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3cf3aaf4cf5d04947a2f98fe: done: 0.027267 sec","job_status":"done","queue_duration_s":1.76709,"scheduling_latency_s":1.767126,"redis_calls":13,"redis_duration_s":0.003111,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015227,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027267,"completed_at":"2026-09-04T07:28:06.687Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.561118] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a291546aab42702c39f33108","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a291546aab42702c39f33108: start","job_status":"start","queue_duration_s":1.796224,"scheduling_latency_s":1.796256} gitlab # [ 262.573881] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a291546aab42702c39f33108","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a291546aab42702c39f33108: done: 0.026202 sec","job_status":"done","queue_duration_s":1.796224,"scheduling_latency_s":1.796256,"redis_calls":13,"redis_duration_s":0.00383,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001618,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026202,"completed_at":"2026-09-04T07:28:06.715Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.614329] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"749ee32bcf15ad5dc3cd6d84","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-749ee32bcf15ad5dc3cd6d84: start","job_status":"start","queue_duration_s":1.824614,"scheduling_latency_s":1.824649} gitlab # [ 262.627540] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"749ee32bcf15ad5dc3cd6d84","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-749ee32bcf15ad5dc3cd6d84: done: 0.026347 sec","job_status":"done","queue_duration_s":1.824614,"scheduling_latency_s":1.824649,"redis_calls":13,"redis_duration_s":0.002777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001741,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026347,"completed_at":"2026-09-04T07:28:06.744Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.668461] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a373c301503f7f85c5ec8e7","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a373c301503f7f85c5ec8e7: start","job_status":"start","queue_duration_s":1.852988,"scheduling_latency_s":1.853025} gitlab # [ 262.681412] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a373c301503f7f85c5ec8e7","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a373c301503f7f85c5ec8e7: done: 0.02758 sec","job_status":"done","queue_duration_s":1.852988,"scheduling_latency_s":1.853025,"redis_calls":13,"redis_duration_s":0.002823,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02758,"completed_at":"2026-09-04T07:28:06.773Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.724747] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b09c33ff6df74c2e41170378","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b09c33ff6df74c2e41170378: start","job_status":"start","queue_duration_s":1.88267,"scheduling_latency_s":1.882708} gitlab # [ 262.737728] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b09c33ff6df74c2e41170378","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b09c33ff6df74c2e41170378: done: 0.02586 sec","job_status":"done","queue_duration_s":1.88267,"scheduling_latency_s":1.882708,"redis_calls":13,"redis_duration_s":0.002856,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02586,"completed_at":"2026-09-04T07:28:06.801Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.777930] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6926c2aa8525c673063fdbd0","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6926c2aa8525c673063fdbd0: start","job_status":"start","queue_duration_s":1.910658,"scheduling_latency_s":1.910695} gitlab # [ 262.790840] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.830Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6926c2aa8525c673063fdbd0","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6926c2aa8525c673063fdbd0: done: 0.026402 sec","job_status":"done","queue_duration_s":1.910658,"scheduling_latency_s":1.910695,"redis_calls":13,"redis_duration_s":0.002748,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026402,"completed_at":"2026-09-04T07:28:06.830Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.832420] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daf906255666660d8d073ea1","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daf906255666660d8d073ea1: start","job_status":"start","queue_duration_s":1.939233,"scheduling_latency_s":1.93927} gitlab # [ 262.846378] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"daf906255666660d8d073ea1","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-daf906255666660d8d073ea1: done: 0.026693 sec","job_status":"done","queue_duration_s":1.939233,"scheduling_latency_s":1.93927,"redis_calls":13,"redis_duration_s":0.002667,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001637,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026693,"completed_at":"2026-09-04T07:28:06.859Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.888268] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.861Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b226d4a7a050d096786ed55a","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b226d4a7a050d096786ed55a: start","job_status":"start","queue_duration_s":1.968434,"scheduling_latency_s":1.968473} gitlab # [ 262.903000] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b226d4a7a050d096786ed55a","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b226d4a7a050d096786ed55a: done: 0.025905 sec","job_status":"done","queue_duration_s":1.968434,"scheduling_latency_s":1.968473,"redis_calls":13,"redis_duration_s":0.002765,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001079,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001686,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025905,"completed_at":"2026-09-04T07:28:06.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.945217] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f305a0b5f4c8ba2ce8f7c97","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f305a0b5f4c8ba2ce8f7c97: start","job_status":"start","queue_duration_s":1.99654,"scheduling_latency_s":1.996577} gitlab # [ 262.958519] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f305a0b5f4c8ba2ce8f7c97","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f305a0b5f4c8ba2ce8f7c97: done: 0.025749 sec","job_status":"done","queue_duration_s":1.99654,"scheduling_latency_s":1.996577,"redis_calls":13,"redis_duration_s":0.002974,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025749,"completed_at":"2026-09-04T07:28:06.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.000212] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4e00e76daeab0ffef285245","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4e00e76daeab0ffef285245: start","job_status":"start","queue_duration_s":2.024384,"scheduling_latency_s":2.024419} gitlab # [ 263.013346] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4e00e76daeab0ffef285245","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4e00e76daeab0ffef285245: done: 0.025836 sec","job_status":"done","queue_duration_s":2.024384,"scheduling_latency_s":2.024419,"redis_calls":13,"redis_duration_s":0.0027619999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001075,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001687,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017287,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025836,"completed_at":"2026-09-04T07:28:06.943Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.055250] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"376c47bc490ea5cf8fc03002","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-376c47bc490ea5cf8fc03002: start","job_status":"start","queue_duration_s":2.052255,"scheduling_latency_s":2.052292} gitlab # [ 263.068715] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"376c47bc490ea5cf8fc03002","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-376c47bc490ea5cf8fc03002: done: 0.026896 sec","job_status":"done","queue_duration_s":2.052255,"scheduling_latency_s":2.052292,"redis_calls":13,"redis_duration_s":0.002789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001028,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001761,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017402,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026896,"completed_at":"2026-09-04T07:28:06.972Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.111571] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:06.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"927dfe569b21e952965c26ac","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-927dfe569b21e952965c26ac: start","job_status":"start","queue_duration_s":2.081745,"scheduling_latency_s":2.081784} gitlab # [ 263.125054] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.001Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"927dfe569b21e952965c26ac","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-927dfe569b21e952965c26ac: done: 0.025897 sec","job_status":"done","queue_duration_s":2.081745,"scheduling_latency_s":2.081784,"redis_calls":13,"redis_duration_s":0.002763,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001023,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025897,"completed_at":"2026-09-04T07:28:07.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.166910] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.003Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9530c8cc179d9999d0f35758","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9530c8cc179d9999d0f35758: start","job_status":"start","queue_duration_s":2.10979,"scheduling_latency_s":2.109829} gitlab # [ 263.180290] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.023Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9530c8cc179d9999d0f35758","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9530c8cc179d9999d0f35758: done: 0.01991 sec","job_status":"done","queue_duration_s":2.10979,"scheduling_latency_s":2.109829,"redis_calls":13,"redis_duration_s":0.001862,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001236,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01991,"completed_at":"2026-09-04T07:28:07.022Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.221692] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39a564936cfea4b1e7095d59","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39a564936cfea4b1e7095d59: start","job_status":"start","queue_duration_s":2.131191,"scheduling_latency_s":2.131221} gitlab # [ 263.234893] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39a564936cfea4b1e7095d59","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39a564936cfea4b1e7095d59: done: 0.017973 sec","job_status":"done","queue_duration_s":2.131191,"scheduling_latency_s":2.131221,"redis_calls":13,"redis_duration_s":0.0018150000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000666,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001149,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017973,"completed_at":"2026-09-04T07:28:07.042Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.276364] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bf78b51a2cf3ea2e4a42f56","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bf78b51a2cf3ea2e4a42f56: start","job_status":"start","queue_duration_s":2.150744,"scheduling_latency_s":2.150771} gitlab # [ 263.289534] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5bf78b51a2cf3ea2e4a42f56","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5bf78b51a2cf3ea2e4a42f56: done: 0.018397 sec","job_status":"done","queue_duration_s":2.150744,"scheduling_latency_s":2.150771,"redis_calls":13,"redis_duration_s":0.002161,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018397,"completed_at":"2026-09-04T07:28:07.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.333159] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3650c3fa3c598ffb338ddc7","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3650c3fa3c598ffb338ddc7: start","job_status":"start","queue_duration_s":2.170903,"scheduling_latency_s":2.170931} gitlab # [ 263.346440] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e3650c3fa3c598ffb338ddc7","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e3650c3fa3c598ffb338ddc7: done: 0.018832 sec","job_status":"done","queue_duration_s":2.170903,"scheduling_latency_s":2.170931,"redis_calls":13,"redis_duration_s":0.00199,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001193,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011761,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018832,"completed_at":"2026-09-04T07:28:07.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.388147] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79ac2109e71fb0546f806128","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79ac2109e71fb0546f806128: start","job_status":"start","queue_duration_s":2.191385,"scheduling_latency_s":2.191412} gitlab # [ 263.401304] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79ac2109e71fb0546f806128","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79ac2109e71fb0546f806128: done: 0.018554 sec","job_status":"done","queue_duration_s":2.191385,"scheduling_latency_s":2.191412,"redis_calls":13,"redis_duration_s":0.002029,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001288,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012265,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018554,"completed_at":"2026-09-04T07:28:07.103Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.443676] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b631de94d1ea2a68868a8335","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b631de94d1ea2a68868a8335: start","job_status":"start","queue_duration_s":2.211604,"scheduling_latency_s":2.211633} gitlab # [ 263.457097] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.123Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b631de94d1ea2a68868a8335","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b631de94d1ea2a68868a8335: done: 0.018689 sec","job_status":"done","queue_duration_s":2.211604,"scheduling_latency_s":2.211633,"redis_calls":13,"redis_duration_s":0.002025,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000722,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001303,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018689,"completed_at":"2026-09-04T07:28:07.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.498887] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be45666228b1fa58cca1ce02","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be45666228b1fa58cca1ce02: start","job_status":"start","queue_duration_s":2.231931,"scheduling_latency_s":2.231961} gitlab # [ 263.513422] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.143Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"be45666228b1fa58cca1ce02","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-be45666228b1fa58cca1ce02: done: 0.018658 sec","job_status":"done","queue_duration_s":2.231931,"scheduling_latency_s":2.231961,"redis_calls":13,"redis_duration_s":0.001983,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00075,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001233,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012324,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018658,"completed_at":"2026-09-04T07:28:07.143Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.555157] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bdb3bc484ade8fd134bd903","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bdb3bc484ade8fd134bd903: start","job_status":"start","queue_duration_s":2.252216,"scheduling_latency_s":2.252245} gitlab # [ 263.568594] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bdb3bc484ade8fd134bd903","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bdb3bc484ade8fd134bd903: done: 0.019517 sec","job_status":"done","queue_duration_s":2.252216,"scheduling_latency_s":2.252245,"redis_calls":13,"redis_duration_s":0.002297,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001243,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019517,"completed_at":"2026-09-04T07:28:07.165Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.610515] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc1314fe2d3b649664d4cc17","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc1314fe2d3b649664d4cc17: start","job_status":"start","queue_duration_s":2.273479,"scheduling_latency_s":2.273532} gitlab # [ 263.624022] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.188Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc1314fe2d3b649664d4cc17","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc1314fe2d3b649664d4cc17: done: 0.021212 sec","job_status":"done","queue_duration_s":2.273479,"scheduling_latency_s":2.273532,"redis_calls":13,"redis_duration_s":0.00211,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001353,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021212,"completed_at":"2026-09-04T07:28:07.187Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.664664] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ba76ff2e8df7b9aaaa48e66","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ba76ff2e8df7b9aaaa48e66: start","job_status":"start","queue_duration_s":2.296426,"scheduling_latency_s":2.296457} gitlab # [ 263.677759] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.211Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ba76ff2e8df7b9aaaa48e66","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ba76ff2e8df7b9aaaa48e66: done: 0.021338 sec","job_status":"done","queue_duration_s":2.296426,"scheduling_latency_s":2.296457,"redis_calls":13,"redis_duration_s":0.00271,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000813,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013595,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021338,"completed_at":"2026-09-04T07:28:07.211Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.720707] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55e8596000e73ff55c9c1161","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55e8596000e73ff55c9c1161: start","job_status":"start","queue_duration_s":2.319588,"scheduling_latency_s":2.319617} gitlab # [ 263.733883] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.235Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55e8596000e73ff55c9c1161","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55e8596000e73ff55c9c1161: done: 0.022374 sec","job_status":"done","queue_duration_s":2.319588,"scheduling_latency_s":2.319617,"redis_calls":13,"redis_duration_s":0.002197,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000816,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001381,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022374,"completed_at":"2026-09-04T07:28:07.235Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.774419] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48e6f3990b48100083d46a86","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48e6f3990b48100083d46a86: start","job_status":"start","queue_duration_s":2.343697,"scheduling_latency_s":2.343726} gitlab # [ 263.787764] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48e6f3990b48100083d46a86","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48e6f3990b48100083d46a86: done: 0.021975 sec","job_status":"done","queue_duration_s":2.343697,"scheduling_latency_s":2.343726,"redis_calls":13,"redis_duration_s":0.002137,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00083,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001307,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021975,"completed_at":"2026-09-04T07:28:07.258Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.829451] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.261Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a59d80735abacc7686174e4f","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a59d80735abacc7686174e4f: start","job_status":"start","queue_duration_s":2.367812,"scheduling_latency_s":2.367845} gitlab # [ 263.842661] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a59d80735abacc7686174e4f","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a59d80735abacc7686174e4f: done: 0.021769 sec","job_status":"done","queue_duration_s":2.367812,"scheduling_latency_s":2.367845,"redis_calls":13,"redis_duration_s":0.002259,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001314,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021769,"completed_at":"2026-09-04T07:28:07.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.884405] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5965462643c899e7bf25ec84","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5965462643c899e7bf25ec84: start","job_status":"start","queue_duration_s":2.391893,"scheduling_latency_s":2.391924} gitlab # [ 263.897602] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.306Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5965462643c899e7bf25ec84","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5965462643c899e7bf25ec84: done: 0.021144 sec","job_status":"done","queue_duration_s":2.391893,"scheduling_latency_s":2.391924,"redis_calls":13,"redis_duration_s":0.002147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000836,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001311,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021144,"completed_at":"2026-09-04T07:28:07.306Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.940725] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3abca0653a596f35edb39d5c","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3abca0653a596f35edb39d5c: start","job_status":"start","queue_duration_s":2.415431,"scheduling_latency_s":2.415462} gitlab # [ 263.953933] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3abca0653a596f35edb39d5c","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3abca0653a596f35edb39d5c: done: 0.021055 sec","job_status":"done","queue_duration_s":2.415431,"scheduling_latency_s":2.415462,"redis_calls":13,"redis_duration_s":0.002116,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000788,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001328,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021055,"completed_at":"2026-09-04T07:28:07.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 263.995910] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27cc6127421205b3cabdecda","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27cc6127421205b3cabdecda: start","job_status":"start","queue_duration_s":2.438887,"scheduling_latency_s":2.438918} gitlab # [ 264.009461] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27cc6127421205b3cabdecda","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27cc6127421205b3cabdecda: done: 0.021243 sec","job_status":"done","queue_duration_s":2.438887,"scheduling_latency_s":2.438918,"redis_calls":13,"redis_duration_s":0.00219,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000782,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001408,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021243,"completed_at":"2026-09-04T07:28:07.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 264.051323] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f9d1e76ed5341f02a7b7877","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f9d1e76ed5341f02a7b7877: start","job_status":"start","queue_duration_s":2.462412,"scheduling_latency_s":2.462445} gitlab # [ 264.064781] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f9d1e76ed5341f02a7b7877","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f9d1e76ed5341f02a7b7877: done: 0.022062 sec","job_status":"done","queue_duration_s":2.462412,"scheduling_latency_s":2.462445,"redis_calls":13,"redis_duration_s":0.002274,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00084,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001434,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022062,"completed_at":"2026-09-04T07:28:07.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 264.105744] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c3db707b7f154907e19f3d3","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c3db707b7f154907e19f3d3: start","job_status":"start","queue_duration_s":2.486959,"scheduling_latency_s":2.486992} gitlab # [ 264.120195] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c3db707b7f154907e19f3d3","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c3db707b7f154907e19f3d3: done: 0.020889 sec","job_status":"done","queue_duration_s":2.486959,"scheduling_latency_s":2.486992,"redis_calls":13,"redis_duration_s":0.002157,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014194,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020889,"completed_at":"2026-09-04T07:28:07.401Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 264.161975] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa2862762e8c38221dd4070e","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa2862762e8c38221dd4070e: start","job_status":"start","queue_duration_s":2.509715,"scheduling_latency_s":2.509745} gitlab # [ 264.175446] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa2862762e8c38221dd4070e","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa2862762e8c38221dd4070e: done: 0.021639 sec","job_status":"done","queue_duration_s":2.509715,"scheduling_latency_s":2.509745,"redis_calls":13,"redis_duration_s":0.002696,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000797,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021639,"completed_at":"2026-09-04T07:28:07.424Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 264.217473] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d6a834ffc7f37a73339c467","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d6a834ffc7f37a73339c467: start","job_status":"start","queue_duration_s":2.533049,"scheduling_latency_s":2.533079} gitlab # [ 264.230786] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.447Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d6a834ffc7f37a73339c467","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d6a834ffc7f37a73339c467: done: 0.021554 sec","job_status":"done","queue_duration_s":2.533049,"scheduling_latency_s":2.533079,"redis_calls":13,"redis_duration_s":0.002734,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000729,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002005,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021554,"completed_at":"2026-09-04T07:28:07.447Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 264.272865] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3cfd0aa4005a6a67e5df4d7","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3cfd0aa4005a6a67e5df4d7: start","job_status":"start","queue_duration_s":2.556143,"scheduling_latency_s":2.556171} gitlab # [ 264.286019] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3cfd0aa4005a6a67e5df4d7","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3cfd0aa4005a6a67e5df4d7: done: 0.024205 sec","job_status":"done","queue_duration_s":2.556143,"scheduling_latency_s":2.556171,"redis_calls":13,"redis_duration_s":0.0059050000000000005,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00519,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024205,"completed_at":"2026-09-04T07:28:07.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 264.329030] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4409adb61c9f350df93b9f22","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4409adb61c9f350df93b9f22: start","job_status":"start","queue_duration_s":2.581997,"scheduling_latency_s":2.582024} gitlab # [ 264.342038] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4409adb61c9f350df93b9f22","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4409adb61c9f350df93b9f22: done: 0.020162 sec","job_status":"done","queue_duration_s":2.581997,"scheduling_latency_s":2.582024,"redis_calls":13,"redis_duration_s":0.001942,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020162,"completed_at":"2026-09-04T07:28:07.495Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 264.383612] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.497Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"289dd29a2003798f8827ffb7","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-289dd29a2003798f8827ffb7: start","job_status":"start","queue_duration_s":2.603747,"scheduling_latency_s":2.603774} gitlab # [ 264.396957] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:28:07.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"289dd29a2003798f8827ffb7","created_at":"2026-09-04T07:28:04.768Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-ffe0fc623469446a","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d785608261a3e99ad09beb4eb07e5c76","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:28:04.893Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-289dd29a2003798f8827ffb7: done: 0.020735 sec","job_status":"done","queue_duration_s":2.603747,"scheduling_latency_s":2.603774,"redis_calls":13,"redis_duration_s":0.0020610000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00084,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020735,"completed_at":"2026-09-04T07:28:07.517Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.201005] redis[791]: 10 changes in 300 seconds. Saving... gitlab # [ 309.208839] redis[791]: Background saving started by pid 3406 gitlab # [ 309.213275] redis[3406]: BGSAVE done, 433 keys saved, 0 keys skipped, 114631 bytes written. gitlab # [ 309.217905] redis[3406]: DB saved on disk gitlab # [ 309.220276] redis[3406]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB gitlab # [ 309.301143] redis[791]: Background saving terminated with success gitlab # [ 310.852839] postgres[862]: [862] LOG: checkpoint starting: time gitlab # [ 313.212846] gitaly[930]: time="2026-09-04T07:28:58.097Z" level=info msg="burden monitor stats" pid=930 gitlab # [ 314.955338] setup-gitlab-start[3180]: W, [2026-09-04T07:28:59.840375 #3180] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 318.483203] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:03.366Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e7af94c575dbcf1f188be67b","created_at":"2026-09-04T07:29:03.294Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14ecc007ac39e457513daba00a7466ed","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.362Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e7af94c575dbcf1f188be67b: start","job_status":"start","queue_duration_s":0.004174,"scheduling_latency_s":0.004228} gitlab # [ 318.830502] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:03.715Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e7af94c575dbcf1f188be67b","created_at":"2026-09-04T07:29:03.294Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14ecc007ac39e457513daba00a7466ed","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.362Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e7af94c575dbcf1f188be67b: done: 0.349069 sec","job_status":"done","queue_duration_s":0.004174,"scheduling_latency_s":0.004228,"redis_calls":17,"redis_duration_s":0.043207999999999996,"redis_read_bytes":1285,"redis_write_bytes":1411,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.026518,"redis_feature_flag_read_bytes":1280,"redis_feature_flag_write_bytes":700,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013821,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002869,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.072622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.349069,"completed_at":"2026-09-04T07:29:03.715Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.186424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 318.916567] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:03.732Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b0c47004f9f7b566f64a7771","created_at":"2026-09-04T07:29:03.417Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71676ae013886a946edf9cf2df5b8e90","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.437Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b0c47004f9f7b566f64a7771: start","job_status":"start","queue_duration_s":0.294643,"scheduling_latency_s":0.294704} gitlab # [ 318.977656] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:03.862Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b0c47004f9f7b566f64a7771","created_at":"2026-09-04T07:29:03.417Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71676ae013886a946edf9cf2df5b8e90","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.437Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b0c47004f9f7b566f64a7771: done: 0.130571 sec","job_status":"done","queue_duration_s":0.294643,"scheduling_latency_s":0.294704,"redis_calls":11,"redis_duration_s":0.038143,"redis_read_bytes":263,"redis_write_bytes":1233,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000652,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":146,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.030543,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006948,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036675,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0012439,"exclusive_lock_hold_duration_s":0.0226985,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.130571,"completed_at":"2026-09-04T07:29:03.862Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016433,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 319.085686] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:03.885Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a7612d692a980c97b53cdc16","created_at":"2026-09-04T07:29:03.482Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"877d8a89f85a37c12b3c899f4a59501f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.493Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a7612d692a980c97b53cdc16: start","job_status":"start","queue_duration_s":0.392377,"scheduling_latency_s":0.392438} gitlab # [ 319.647097] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.531Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a7612d692a980c97b53cdc16","created_at":"2026-09-04T07:29:03.482Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"877d8a89f85a37c12b3c899f4a59501f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.493Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a7612d692a980c97b53cdc16: done: 0.646301 sec","job_status":"done","queue_duration_s":0.392377,"scheduling_latency_s":0.392438,"redis_calls":10,"redis_duration_s":0.004533,"redis_read_bytes":135,"redis_write_bytes":1071,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000425,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":84,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002002,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002106,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.077,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.077,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.359096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00201612,"exclusive_lock_hold_duration_s":0.50993028,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.646301,"completed_at":"2026-09-04T07:29:04.531Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.230577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 319.745744] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.533Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d2fd73345b03e48fefb9d9bf","created_at":"2026-09-04T07:29:03.513Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c130613aca38ee5544550eb5430906c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.520Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d2fd73345b03e48fefb9d9bf: start","job_status":"start","queue_duration_s":1.012997,"scheduling_latency_s":1.013026} gitlab # [ 319.763572] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.544Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 319.767798] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.551Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"d2fd73345b03e48fefb9d9bf","created_at":"2026-09-04T07:29:03.513Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c130613aca38ee5544550eb5430906c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.520Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-d2fd73345b03e48fefb9d9bf: done: 0.018019 sec","job_status":"done","queue_duration_s":1.012997,"scheduling_latency_s":1.013026,"redis_calls":8,"redis_duration_s":0.002258,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001427,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000567,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018019,"completed_at":"2026-09-04T07:29:04.551Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 319.810461] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.553Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9470d05258a5100a3ecbb141","created_at":"2026-09-04T07:29:03.532Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef4903092a476ac87381e6be4eb52c62","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:29:03.540Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9470d05258a5100a3ecbb141: start","job_status":"start","queue_duration_s":1.013535,"scheduling_latency_s":1.01356} gitlab # [ 319.824201] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9470d05258a5100a3ecbb141","created_at":"2026-09-04T07:29:03.532Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef4903092a476ac87381e6be4eb52c62","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-04T07:29:03.540Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9470d05258a5100a3ecbb141: done: 0.028186 sec","job_status":"done","queue_duration_s":1.013535,"scheduling_latency_s":1.01356,"redis_calls":9,"redis_duration_s":0.0026449999999999998,"redis_read_bytes":261,"redis_write_bytes":906,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000503,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":165,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001571,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000571,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028186,"completed_at":"2026-09-04T07:29:04.581Z","load_balancing_strategy":"primary","db_duration_s":0.002244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 319.867572] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"9766a7df464f832632c56564","created_at":"2026-09-04T07:29:03.560Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7285e5754fc00faaff9b413b188959c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.572Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-9766a7df464f832632c56564: start","job_status":"start","queue_duration_s":1.011756,"scheduling_latency_s":1.011786} gitlab # [ 319.883083] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.595Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 319.887113] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.603Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"9766a7df464f832632c56564","created_at":"2026-09-04T07:29:03.560Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7285e5754fc00faaff9b413b188959c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.572Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-9766a7df464f832632c56564: done: 0.019137 sec","job_status":"done","queue_duration_s":1.011756,"scheduling_latency_s":1.011786,"redis_calls":8,"redis_duration_s":0.0028409999999999998,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000261,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001669,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019137,"completed_at":"2026-09-04T07:29:04.602Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 319.930392] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.605Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f986e6d380d5ec4fde84a42d","created_at":"2026-09-04T07:29:03.585Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eacc1eb6e232e7363b3981ddeb3364af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.596Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f986e6d380d5ec4fde84a42d: start","job_status":"start","queue_duration_s":1.008585,"scheduling_latency_s":1.008614} gitlab # [ 319.943998] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"f986e6d380d5ec4fde84a42d","created_at":"2026-09-04T07:29:03.585Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eacc1eb6e232e7363b3981ddeb3364af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.596Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-f986e6d380d5ec4fde84a42d: done: 0.036274 sec","job_status":"done","queue_duration_s":1.008585,"scheduling_latency_s":1.008614,"redis_calls":16,"redis_duration_s":0.0049440000000000005,"redis_read_bytes":272,"redis_write_bytes":4225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000602,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":199,"redis_queues_calls":2,"redis_queues_duration_s":0.000649,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002781,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036274,"completed_at":"2026-09-04T07:29:04.641Z","load_balancing_strategy":"primary","db_duration_s":0.001702,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 319.987812] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3848e3cec6d7d900365ae768","created_at":"2026-09-04T07:29:03.610Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b788803acb9bd442dbd153fa423b8ea1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:29:03.624Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3848e3cec6d7d900365ae768: start","job_status":"start","queue_duration_s":1.018461,"scheduling_latency_s":1.018492} gitlab # [ 320.001428] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.654Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 320.005132] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3848e3cec6d7d900365ae768","created_at":"2026-09-04T07:29:03.610Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b788803acb9bd442dbd153fa423b8ea1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-04T07:29:03.624Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3848e3cec6d7d900365ae768: done: 0.018128 sec","job_status":"done","queue_duration_s":1.018461,"scheduling_latency_s":1.018492,"redis_calls":8,"redis_duration_s":0.002326,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000259,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001484,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000583,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018128,"completed_at":"2026-09-04T07:29:04.661Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.047817] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.663Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ad1685314b86439df17c142d","created_at":"2026-09-04T07:29:03.683Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.703Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ad1685314b86439df17c142d: start","job_status":"start","queue_duration_s":0.959817,"scheduling_latency_s":0.959844} gitlab # [ 320.061798] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.768Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"ad1685314b86439df17c142d","created_at":"2026-09-04T07:29:03.683Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.703Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-ad1685314b86439df17c142d: done: 0.105215 sec","job_status":"done","queue_duration_s":0.959817,"scheduling_latency_s":0.959844,"redis_calls":60,"redis_duration_s":0.01707,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000969,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.015229,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000872,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.089788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.105215,"completed_at":"2026-09-04T07:29:04.768Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.102818] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.770Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"23190eb9399fff88d951f621","created_at":"2026-09-04T07:29:03.734Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab5de43633eaf47fa5a75910eacf9f3b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.748Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-23190eb9399fff88d951f621: start","job_status":"start","queue_duration_s":1.021739,"scheduling_latency_s":1.021769} gitlab # [ 320.116691] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"23190eb9399fff88d951f621","created_at":"2026-09-04T07:29:03.734Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab5de43633eaf47fa5a75910eacf9f3b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.748Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-23190eb9399fff88d951f621: done: 0.022339 sec","job_status":"done","queue_duration_s":1.021739,"scheduling_latency_s":1.021769,"redis_calls":9,"redis_duration_s":0.0027150000000000004,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001453,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001262,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00071146,"exclusive_lock_hold_duration_s":0.00476692,"duration_s":0.022339,"completed_at":"2026-09-04T07:29:04.792Z","load_balancing_strategy":"primary","db_duration_s":0.001552,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.157659] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.794Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"db5a817d424297731220a486","created_at":"2026-09-04T07:29:03.790Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"144f0dba53a9475c2b516af42baa280d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.803Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-db5a817d424297731220a486: start","job_status":"start","queue_duration_s":0.991031,"scheduling_latency_s":0.991057} gitlab # [ 320.172494] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.876Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"db5a817d424297731220a486","created_at":"2026-09-04T07:29:03.790Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"144f0dba53a9475c2b516af42baa280d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.803Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-db5a817d424297731220a486: done: 0.081807 sec","job_status":"done","queue_duration_s":0.991031,"scheduling_latency_s":0.991057,"redis_calls":9,"redis_duration_s":0.005386999999999999,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002901,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002486,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00186836,"exclusive_lock_hold_duration_s":0.02821556,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.081807,"completed_at":"2026-09-04T07:29:04.876Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017729,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.215864] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.880Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"59aa97ece0e4aaf5f5242f7c","created_at":"2026-09-04T07:29:03.853Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"711dc8839fa04c5d9f68c37b10f86666","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.869Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-59aa97ece0e4aaf5f5242f7c: start","job_status":"start","queue_duration_s":1.011098,"scheduling_latency_s":1.011153} gitlab # [ 320.230444] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"59aa97ece0e4aaf5f5242f7c","created_at":"2026-09-04T07:29:03.853Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"711dc8839fa04c5d9f68c37b10f86666","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.869Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-59aa97ece0e4aaf5f5242f7c: done: 0.039638 sec","job_status":"done","queue_duration_s":1.011098,"scheduling_latency_s":1.011153,"redis_calls":7,"redis_duration_s":0.00331,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000833,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039638,"completed_at":"2026-09-04T07:29:04.919Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.272457] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.923Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b09efefe0674facdae7c273a","created_at":"2026-09-04T07:29:03.883Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"240b56393a153cac3a22ba27dfcba465","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.895Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b09efefe0674facdae7c273a: start","job_status":"start","queue_duration_s":1.02745,"scheduling_latency_s":1.027498} gitlab # [ 320.287257] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.965Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"b09efefe0674facdae7c273a","created_at":"2026-09-04T07:29:03.883Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"240b56393a153cac3a22ba27dfcba465","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.895Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-b09efefe0674facdae7c273a: done: 0.041991 sec","job_status":"done","queue_duration_s":1.02745,"scheduling_latency_s":1.027498,"redis_calls":10,"redis_duration_s":0.004083,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002273,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00181,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0101454,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.041991,"completed_at":"2026-09-04T07:29:04.964Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004992,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 320.330299] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:04.968Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7fc5004c132faecd0c2e80f6","created_at":"2026-09-04T07:29:03.902Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fc5f72543d39bbcbafab7fc76c31f9d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.913Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7fc5004c132faecd0c2e80f6: start","job_status":"start","queue_duration_s":1.054739,"scheduling_latency_s":1.05478} gitlab # [ 320.345650] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.038Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7fc5004c132faecd0c2e80f6","created_at":"2026-09-04T07:29:03.902Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fc5f72543d39bbcbafab7fc76c31f9d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.913Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7fc5004c132faecd0c2e80f6: done: 0.070368 sec","job_status":"done","queue_duration_s":1.054739,"scheduling_latency_s":1.05478,"redis_calls":9,"redis_duration_s":0.004202,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002153,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002049,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00100024,"exclusive_lock_hold_duration_s":0.03822764,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.070368,"completed_at":"2026-09-04T07:29:05.038Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013287,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.390522] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.043Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"198b4295d503c602ecf1907d","created_at":"2026-09-04T07:29:03.924Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b142da41a91b6edaeb794165f1575cb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.932Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-198b4295d503c602ecf1907d: start","job_status":"start","queue_duration_s":1.110933,"scheduling_latency_s":1.110991} gitlab # [ 320.405852] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.078Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"198b4295d503c602ecf1907d","created_at":"2026-09-04T07:29:03.924Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2b142da41a91b6edaeb794165f1575cb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.932Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-198b4295d503c602ecf1907d: done: 0.035071 sec","job_status":"done","queue_duration_s":1.110933,"scheduling_latency_s":1.110991,"redis_calls":7,"redis_duration_s":0.003007,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002144,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000863,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035071,"completed_at":"2026-09-04T07:29:05.078Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.447506] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.093Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fbe7224131003686d59bebae","created_at":"2026-09-04T07:29:03.938Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17f25ab0985579cabcfac6c9037b6c33","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:29:03.945Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fbe7224131003686d59bebae: start","job_status":"start","queue_duration_s":1.148137,"scheduling_latency_s":1.148189} gitlab # [ 320.462833] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.110Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 320.466417] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.123Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"fbe7224131003686d59bebae","created_at":"2026-09-04T07:29:03.938Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17f25ab0985579cabcfac6c9037b6c33","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-04T07:29:03.945Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-fbe7224131003686d59bebae: done: 0.030241 sec","job_status":"done","queue_duration_s":1.148137,"scheduling_latency_s":1.148189,"redis_calls":7,"redis_duration_s":0.003177,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001187,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030241,"completed_at":"2026-09-04T07:29:05.123Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.507583] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.126Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"142affeb1b83db476b78b518","created_at":"2026-09-04T07:29:03.954Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e7acc73bfb126a1a94e61b874a1c17e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.963Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-142affeb1b83db476b78b518: start","job_status":"start","queue_duration_s":1.162644,"scheduling_latency_s":1.162733} gitlab # [ 320.523029] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.142Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 320.526768] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.153Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"142affeb1b83db476b78b518","created_at":"2026-09-04T07:29:03.954Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e7acc73bfb126a1a94e61b874a1c17e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:03.963Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-142affeb1b83db476b78b518: done: 0.02667 sec","job_status":"done","queue_duration_s":1.162644,"scheduling_latency_s":1.162733,"redis_calls":7,"redis_duration_s":0.0025380000000000003,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001809,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000729,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02667,"completed_at":"2026-09-04T07:29:05.153Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.569742] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.155Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"7d05cd7401a3b2f7f8b2cf3e","created_at":"2026-09-04T07:29:04.017Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5d68e458541a467049fd5135dc79ac3","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.026Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-7d05cd7401a3b2f7f8b2cf3e: start","job_status":"start","queue_duration_s":1.128899,"scheduling_latency_s":1.128936} gitlab # [ 320.584100] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"7d05cd7401a3b2f7f8b2cf3e","created_at":"2026-09-04T07:29:04.017Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b5d68e458541a467049fd5135dc79ac3","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.026Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-7d05cd7401a3b2f7f8b2cf3e: done: 0.035806 sec","job_status":"done","queue_duration_s":1.128899,"scheduling_latency_s":1.128936,"redis_calls":7,"redis_duration_s":0.002854,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002049,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000805,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.035806,"completed_at":"2026-09-04T07:29:05.191Z","load_balancing_strategy":"primary","db_duration_s":0.007828,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.627238] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.193Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"474779ec91423cf158990b38","created_at":"2026-09-04T07:29:04.093Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66c0800e7009c665b2d8ce7cc4036f9a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.100Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-474779ec91423cf158990b38: start","job_status":"start","queue_duration_s":1.092862,"scheduling_latency_s":1.092892} gitlab # [ 320.641970] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.520Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"474779ec91423cf158990b38","created_at":"2026-09-04T07:29:04.093Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66c0800e7009c665b2d8ce7cc4036f9a","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.100Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-474779ec91423cf158990b38: done: 0.326951 sec","job_status":"done","queue_duration_s":1.092862,"scheduling_latency_s":1.092892,"redis_calls":562,"redis_duration_s":0.080773,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001304,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.079469,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.287545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.326951,"completed_at":"2026-09-04T07:29:05.520Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.685009] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.521Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3a337d6526b2630b60d8262b","created_at":"2026-09-04T07:29:04.108Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87f5c93ac0d8bcc6a5ae9a61a9e7b33c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.117Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3a337d6526b2630b60d8262b: start","job_status":"start","queue_duration_s":1.404764,"scheduling_latency_s":1.404794} gitlab # [ 320.699857] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3a337d6526b2630b60d8262b","created_at":"2026-09-04T07:29:04.108Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"87f5c93ac0d8bcc6a5ae9a61a9e7b33c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.117Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3a337d6526b2630b60d8262b: done: 0.017345 sec","job_status":"done","queue_duration_s":1.404764,"scheduling_latency_s":1.404794,"redis_calls":8,"redis_duration_s":0.0017360000000000001,"redis_read_bytes":133,"redis_write_bytes":841,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000221,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":65,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001077,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000438,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017345,"completed_at":"2026-09-04T07:29:05.539Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.744316] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.541Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9fab6d40611f04a91d8c64d1","created_at":"2026-09-04T07:29:04.129Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7acde9833cf2e9c42e6adb515af591c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.133Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9fab6d40611f04a91d8c64d1: start","job_status":"start","queue_duration_s":1.407094,"scheduling_latency_s":1.407122} gitlab # [ 320.759526] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.549Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 320.763053] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.556Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"9fab6d40611f04a91d8c64d1","created_at":"2026-09-04T07:29:04.129Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-17e68b7f7ebd4219","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d7acde9833cf2e9c42e6adb515af591c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.133Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-9fab6d40611f04a91d8c64d1: done: 0.015528 sec","job_status":"done","queue_duration_s":1.407094,"scheduling_latency_s":1.407122,"redis_calls":7,"redis_duration_s":0.001688,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001217,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009308,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015528,"completed_at":"2026-09-04T07:29:05.556Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.805846] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.558Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3c9edc8006914c061ef1a5e2","created_at":"2026-09-04T07:29:04.620Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-56cf6f708b55486b","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eacc1eb6e232e7363b3981ddeb3364af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.633Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3c9edc8006914c061ef1a5e2: start","job_status":"start","queue_duration_s":0.924814,"scheduling_latency_s":0.924839} gitlab # [ 320.818783] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.574Z","message":"No existing merge request to be cleaned up."} gitlab # [ 320.820637] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.600Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3c9edc8006914c061ef1a5e2","created_at":"2026-09-04T07:29:04.620Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-56cf6f708b55486b","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eacc1eb6e232e7363b3981ddeb3364af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.633Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3c9edc8006914c061ef1a5e2: done: 0.040416 sec","job_status":"done","queue_duration_s":0.924814,"scheduling_latency_s":0.924839,"redis_calls":10,"redis_duration_s":0.003661,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002115,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040416,"completed_at":"2026-09-04T07:29:05.598Z","load_balancing_strategy":"primary","db_duration_s":0.003703,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.860864] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.603Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dea29477649e6156f1c2559c","created_at":"2026-09-04T07:29:04.620Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-56cf6f708b55486b","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eacc1eb6e232e7363b3981ddeb3364af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.633Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dea29477649e6156f1c2559c: start","job_status":"start","queue_duration_s":0.970221,"scheduling_latency_s":0.970272} gitlab # [ 320.874635] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.630Z","message":"No existing merge request to be cleaned up."} gitlab # [ 320.876392] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.651Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"dea29477649e6156f1c2559c","created_at":"2026-09-04T07:29:04.620Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-56cf6f708b55486b","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eacc1eb6e232e7363b3981ddeb3364af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.633Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-dea29477649e6156f1c2559c: done: 0.047788 sec","job_status":"done","queue_duration_s":0.970221,"scheduling_latency_s":0.970272,"redis_calls":10,"redis_duration_s":0.003922,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001647,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002275,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047788,"completed_at":"2026-09-04T07:29:05.651Z","load_balancing_strategy":"primary","db_duration_s":0.003712,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.915444] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.654Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2c000eefa409350affc2730d","created_at":"2026-09-04T07:29:04.620Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-56cf6f708b55486b","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eacc1eb6e232e7363b3981ddeb3364af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.633Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2c000eefa409350affc2730d: start","job_status":"start","queue_duration_s":1.020757,"scheduling_latency_s":1.020801} gitlab # [ 320.927767] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.677Z","message":"No existing merge request to be cleaned up."} gitlab # [ 320.929612] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.692Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2c000eefa409350affc2730d","created_at":"2026-09-04T07:29:04.620Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-56cf6f708b55486b","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eacc1eb6e232e7363b3981ddeb3364af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.633Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2c000eefa409350affc2730d: done: 0.03864 sec","job_status":"done","queue_duration_s":1.020757,"scheduling_latency_s":1.020801,"redis_calls":10,"redis_duration_s":0.004024,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002476,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03864,"completed_at":"2026-09-04T07:29:05.692Z","load_balancing_strategy":"primary","db_duration_s":0.003966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 320.968967] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.694Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"67714aac8ea89b6f72bfe652","created_at":"2026-09-04T07:29:04.620Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-56cf6f708b55486b","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eacc1eb6e232e7363b3981ddeb3364af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.633Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-67714aac8ea89b6f72bfe652: start","job_status":"start","queue_duration_s":1.061428,"scheduling_latency_s":1.061462} gitlab # [ 320.981619] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.711Z","message":"No existing merge request to be cleaned up."} gitlab # [ 320.983347] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.723Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"67714aac8ea89b6f72bfe652","created_at":"2026-09-04T07:29:04.620Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-56cf6f708b55486b","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"eacc1eb6e232e7363b3981ddeb3364af","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.633Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-67714aac8ea89b6f72bfe652: done: 0.029077 sec","job_status":"done","queue_duration_s":1.061428,"scheduling_latency_s":1.061462,"redis_calls":10,"redis_duration_s":0.003068,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00125,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001818,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029077,"completed_at":"2026-09-04T07:29:05.723Z","load_balancing_strategy":"primary","db_duration_s":0.00328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.022138] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b9c6a8bb91193edbf500ab8","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b9c6a8bb91193edbf500ab8: start","job_status":"start","queue_duration_s":0.966292,"scheduling_latency_s":0.966324} gitlab # [ 321.034976] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b9c6a8bb91193edbf500ab8","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b9c6a8bb91193edbf500ab8: done: 0.024266 sec","job_status":"done","queue_duration_s":0.966292,"scheduling_latency_s":0.966324,"redis_calls":17,"redis_duration_s":0.004258,"redis_read_bytes":522,"redis_write_bytes":1453,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001021,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":296,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001118,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002119,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024266,"completed_at":"2026-09-04T07:29:05.749Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.077556] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b507450cff90cde637ab2a4a","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b507450cff90cde637ab2a4a: start","job_status":"start","queue_duration_s":0.992874,"scheduling_latency_s":0.992905} gitlab # [ 321.090736] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b507450cff90cde637ab2a4a","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b507450cff90cde637ab2a4a: done: 0.019041 sec","job_status":"done","queue_duration_s":0.992874,"scheduling_latency_s":0.992905,"redis_calls":13,"redis_duration_s":0.0029709999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019041,"completed_at":"2026-09-04T07:29:05.771Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.131830] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"790d2bc6a43f79a97407ff72","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-790d2bc6a43f79a97407ff72: start","job_status":"start","queue_duration_s":1.0137,"scheduling_latency_s":1.013727} gitlab # [ 321.145069] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"790d2bc6a43f79a97407ff72","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-790d2bc6a43f79a97407ff72: done: 0.018461 sec","job_status":"done","queue_duration_s":1.0137,"scheduling_latency_s":1.013727,"redis_calls":13,"redis_duration_s":0.0030410000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011248,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018461,"completed_at":"2026-09-04T07:29:05.791Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.187224] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33d802373297ebfcc13b509a","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33d802373297ebfcc13b509a: start","job_status":"start","queue_duration_s":1.033815,"scheduling_latency_s":1.033837} gitlab # [ 321.200865] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"33d802373297ebfcc13b509a","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-33d802373297ebfcc13b509a: done: 0.018572 sec","job_status":"done","queue_duration_s":1.033815,"scheduling_latency_s":1.033837,"redis_calls":13,"redis_duration_s":0.003195,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018572,"completed_at":"2026-09-04T07:29:05.811Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.242735] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da7f5ee1fe7b6f4259ee4d02","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da7f5ee1fe7b6f4259ee4d02: start","job_status":"start","queue_duration_s":1.054164,"scheduling_latency_s":1.05419} gitlab # [ 321.256063] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da7f5ee1fe7b6f4259ee4d02","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da7f5ee1fe7b6f4259ee4d02: done: 0.01945 sec","job_status":"done","queue_duration_s":1.054164,"scheduling_latency_s":1.05419,"redis_calls":13,"redis_duration_s":0.003155,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01945,"completed_at":"2026-09-04T07:29:05.833Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.297052] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9aa57ab3c4247d4116c2305c","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9aa57ab3c4247d4116c2305c: start","job_status":"start","queue_duration_s":1.075453,"scheduling_latency_s":1.075478} gitlab # [ 321.309556] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9aa57ab3c4247d4116c2305c","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9aa57ab3c4247d4116c2305c: done: 0.019004 sec","job_status":"done","queue_duration_s":1.075453,"scheduling_latency_s":1.075478,"redis_calls":13,"redis_duration_s":0.003307,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001084,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002223,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019004,"completed_at":"2026-09-04T07:29:05.853Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.350900] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99a63c609f0456e6b4cd4b12","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99a63c609f0456e6b4cd4b12: start","job_status":"start","queue_duration_s":1.096285,"scheduling_latency_s":1.096314} gitlab # [ 321.363841] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99a63c609f0456e6b4cd4b12","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99a63c609f0456e6b4cd4b12: done: 0.018509 sec","job_status":"done","queue_duration_s":1.096285,"scheduling_latency_s":1.096314,"redis_calls":13,"redis_duration_s":0.00297,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018509,"completed_at":"2026-09-04T07:29:05.874Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.404282] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.876Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce2164e60a7873a17f8981af","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce2164e60a7873a17f8981af: start","job_status":"start","queue_duration_s":1.116633,"scheduling_latency_s":1.116658} gitlab # [ 321.416865] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.895Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce2164e60a7873a17f8981af","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce2164e60a7873a17f8981af: done: 0.019092 sec","job_status":"done","queue_duration_s":1.116633,"scheduling_latency_s":1.116658,"redis_calls":13,"redis_duration_s":0.00317,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002076,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011521,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019092,"completed_at":"2026-09-04T07:29:05.895Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.457075] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab3c1b2af5380564912efad8","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab3c1b2af5380564912efad8: start","job_status":"start","queue_duration_s":1.138629,"scheduling_latency_s":1.138659} gitlab # [ 321.469439] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ab3c1b2af5380564912efad8","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ab3c1b2af5380564912efad8: done: 0.019269 sec","job_status":"done","queue_duration_s":1.138629,"scheduling_latency_s":1.138659,"redis_calls":13,"redis_duration_s":0.0032459999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002144,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019269,"completed_at":"2026-09-04T07:29:05.917Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.510029] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.919Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6caab86f2d7677b9781dc43","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6caab86f2d7677b9781dc43: start","job_status":"start","queue_duration_s":1.159764,"scheduling_latency_s":1.159789} gitlab # [ 321.522539] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6caab86f2d7677b9781dc43","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6caab86f2d7677b9781dc43: done: 0.038878 sec","job_status":"done","queue_duration_s":1.159764,"scheduling_latency_s":1.159789,"redis_calls":13,"redis_duration_s":0.003125,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001191,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031245,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038878,"completed_at":"2026-09-04T07:29:05.958Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.561411] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"998962a4a4236a2c7fed0443","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-998962a4a4236a2c7fed0443: start","job_status":"start","queue_duration_s":1.200529,"scheduling_latency_s":1.200559} gitlab # [ 321.573815] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"998962a4a4236a2c7fed0443","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-998962a4a4236a2c7fed0443: done: 0.019469 sec","job_status":"done","queue_duration_s":1.200529,"scheduling_latency_s":1.200559,"redis_calls":13,"redis_duration_s":0.0029969999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012352,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019469,"completed_at":"2026-09-04T07:29:05.979Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.616186] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:05.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c367a6471707daf621405a23","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c367a6471707daf621405a23: start","job_status":"start","queue_duration_s":1.221796,"scheduling_latency_s":1.221823} gitlab # [ 321.629486] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.000Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c367a6471707daf621405a23","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c367a6471707daf621405a23: done: 0.019688 sec","job_status":"done","queue_duration_s":1.221796,"scheduling_latency_s":1.221823,"redis_calls":13,"redis_duration_s":0.003176,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001064,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002112,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011474,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019688,"completed_at":"2026-09-04T07:29:06.000Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.671589] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f48fce8be37729186f5a117","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f48fce8be37729186f5a117: start","job_status":"start","queue_duration_s":1.244565,"scheduling_latency_s":1.244596} gitlab # [ 321.686655] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f48fce8be37729186f5a117","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f48fce8be37729186f5a117: done: 0.020061 sec","job_status":"done","queue_duration_s":1.244565,"scheduling_latency_s":1.244596,"redis_calls":13,"redis_duration_s":0.003142,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001156,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020061,"completed_at":"2026-09-04T07:29:06.024Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.729323] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b30e0386ff1c9aa20887bed3","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b30e0386ff1c9aa20887bed3: start","job_status":"start","queue_duration_s":1.266348,"scheduling_latency_s":1.266375} gitlab # [ 321.742682] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b30e0386ff1c9aa20887bed3","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b30e0386ff1c9aa20887bed3: done: 0.019584 sec","job_status":"done","queue_duration_s":1.266348,"scheduling_latency_s":1.266375,"redis_calls":13,"redis_duration_s":0.003069,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002027,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019584,"completed_at":"2026-09-04T07:29:06.045Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.783733] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db852fca02ec1418f70b941c","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db852fca02ec1418f70b941c: start","job_status":"start","queue_duration_s":1.287688,"scheduling_latency_s":1.287714} gitlab # [ 321.797038] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.066Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db852fca02ec1418f70b941c","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db852fca02ec1418f70b941c: done: 0.019052 sec","job_status":"done","queue_duration_s":1.287688,"scheduling_latency_s":1.287714,"redis_calls":13,"redis_duration_s":0.002908,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001028,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00188,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019052,"completed_at":"2026-09-04T07:29:06.066Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.837619] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e955922edabebb18ff76a3b9","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e955922edabebb18ff76a3b9: start","job_status":"start","queue_duration_s":1.308492,"scheduling_latency_s":1.308519} gitlab # [ 321.850938] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e955922edabebb18ff76a3b9","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e955922edabebb18ff76a3b9: done: 0.021262 sec","job_status":"done","queue_duration_s":1.308492,"scheduling_latency_s":1.308519,"redis_calls":13,"redis_duration_s":0.003623,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001036,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002587,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021262,"completed_at":"2026-09-04T07:29:06.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.893212] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ff2db58750f1d24ccb9d88d","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ff2db58750f1d24ccb9d88d: start","job_status":"start","queue_duration_s":1.331579,"scheduling_latency_s":1.331604} gitlab # [ 321.906232] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ff2db58750f1d24ccb9d88d","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ff2db58750f1d24ccb9d88d: done: 0.020895 sec","job_status":"done","queue_duration_s":1.331579,"scheduling_latency_s":1.331604,"redis_calls":13,"redis_duration_s":0.003462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001178,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002284,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020895,"completed_at":"2026-09-04T07:29:06.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 321.946504] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc491d94fa8021f26a08dda2","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc491d94fa8021f26a08dda2: start","job_status":"start","queue_duration_s":1.354343,"scheduling_latency_s":1.35437} gitlab # [ 321.959793] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc491d94fa8021f26a08dda2","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc491d94fa8021f26a08dda2: done: 0.020681 sec","job_status":"done","queue_duration_s":1.354343,"scheduling_latency_s":1.35437,"redis_calls":13,"redis_duration_s":0.003248,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002161,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020681,"completed_at":"2026-09-04T07:29:06.134Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.001759] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"109a01c1a42ce6a2a57bc2b4","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-109a01c1a42ce6a2a57bc2b4: start","job_status":"start","queue_duration_s":1.378229,"scheduling_latency_s":1.378256} gitlab # [ 322.015894] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.158Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"109a01c1a42ce6a2a57bc2b4","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-109a01c1a42ce6a2a57bc2b4: done: 0.020614 sec","job_status":"done","queue_duration_s":1.378229,"scheduling_latency_s":1.378256,"redis_calls":13,"redis_duration_s":0.003236,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002133,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020614,"completed_at":"2026-09-04T07:29:06.158Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.059487] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21de95cb00365a252ee58029","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21de95cb00365a252ee58029: start","job_status":"start","queue_duration_s":1.40067,"scheduling_latency_s":1.400695} gitlab # [ 322.072817] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21de95cb00365a252ee58029","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21de95cb00365a252ee58029: done: 0.018622 sec","job_status":"done","queue_duration_s":1.40067,"scheduling_latency_s":1.400695,"redis_calls":13,"redis_duration_s":0.002699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018622,"completed_at":"2026-09-04T07:29:06.178Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.117824] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da82df1998e1d47fe3041687","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da82df1998e1d47fe3041687: start","job_status":"start","queue_duration_s":1.420973,"scheduling_latency_s":1.420995} gitlab # [ 322.155228] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da82df1998e1d47fe3041687","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da82df1998e1d47fe3041687: done: 0.020731 sec","job_status":"done","queue_duration_s":1.420973,"scheduling_latency_s":1.420995,"redis_calls":13,"redis_duration_s":0.003095,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011345,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020731,"completed_at":"2026-09-04T07:29:06.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.220658] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a439450b8a1d7ebe0ca807a","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a439450b8a1d7ebe0ca807a: start","job_status":"start","queue_duration_s":1.447924,"scheduling_latency_s":1.447948} gitlab # [ 322.234650] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.228Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a439450b8a1d7ebe0ca807a","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a439450b8a1d7ebe0ca807a: done: 0.02098 sec","job_status":"done","queue_duration_s":1.447924,"scheduling_latency_s":1.447948,"redis_calls":13,"redis_duration_s":0.003268,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001106,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013431,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02098,"completed_at":"2026-09-04T07:29:06.228Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.276118] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13a66f82bca647da70ba06ec","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13a66f82bca647da70ba06ec: start","job_status":"start","queue_duration_s":1.470658,"scheduling_latency_s":1.470683} gitlab # [ 322.289187] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13a66f82bca647da70ba06ec","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13a66f82bca647da70ba06ec: done: 0.021125 sec","job_status":"done","queue_duration_s":1.470658,"scheduling_latency_s":1.470683,"redis_calls":13,"redis_duration_s":0.0031810000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001108,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021125,"completed_at":"2026-09-04T07:29:06.251Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.331090] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.253Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9f847f8c2e0573319e101f0","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9f847f8c2e0573319e101f0: start","job_status":"start","queue_duration_s":1.493518,"scheduling_latency_s":1.493542} gitlab # [ 322.344475] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.273Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9f847f8c2e0573319e101f0","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9f847f8c2e0573319e101f0: done: 0.020498 sec","job_status":"done","queue_duration_s":1.493518,"scheduling_latency_s":1.493542,"redis_calls":13,"redis_duration_s":0.00321,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00214,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020498,"completed_at":"2026-09-04T07:29:06.273Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.386120] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.277Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cce79445124f4e9e8cef48ac","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cce79445124f4e9e8cef48ac: start","job_status":"start","queue_duration_s":1.517679,"scheduling_latency_s":1.517708} gitlab # [ 322.399352] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cce79445124f4e9e8cef48ac","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cce79445124f4e9e8cef48ac: done: 0.02114 sec","job_status":"done","queue_duration_s":1.517679,"scheduling_latency_s":1.517708,"redis_calls":13,"redis_duration_s":0.0035529999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001143,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00241,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02114,"completed_at":"2026-09-04T07:29:06.298Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.440381] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97d0a12da43daa30bb97e7dd","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97d0a12da43daa30bb97e7dd: start","job_status":"start","queue_duration_s":1.540573,"scheduling_latency_s":1.540595} gitlab # [ 322.453440] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97d0a12da43daa30bb97e7dd","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97d0a12da43daa30bb97e7dd: done: 0.020589 sec","job_status":"done","queue_duration_s":1.540573,"scheduling_latency_s":1.540595,"redis_calls":14,"redis_duration_s":0.0033339999999999997,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000249,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001067,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020589,"completed_at":"2026-09-04T07:29:06.320Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.496227] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a628a355ba1f6b6dd958cdcb","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a628a355ba1f6b6dd958cdcb: start","job_status":"start","queue_duration_s":1.56298,"scheduling_latency_s":1.563004} gitlab # [ 322.509934] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a628a355ba1f6b6dd958cdcb","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a628a355ba1f6b6dd958cdcb: done: 0.020575 sec","job_status":"done","queue_duration_s":1.56298,"scheduling_latency_s":1.563004,"redis_calls":13,"redis_duration_s":0.003165,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020575,"completed_at":"2026-09-04T07:29:06.342Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.551107] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69a0b0af70cf273c440a2795","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69a0b0af70cf273c440a2795: start","job_status":"start","queue_duration_s":1.586979,"scheduling_latency_s":1.587009} gitlab # [ 322.564661] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69a0b0af70cf273c440a2795","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69a0b0af70cf273c440a2795: done: 0.02074 sec","job_status":"done","queue_duration_s":1.586979,"scheduling_latency_s":1.587009,"redis_calls":13,"redis_duration_s":0.003151,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00109,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002061,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02074,"completed_at":"2026-09-04T07:29:06.367Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.606408] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e99fbbcd5859211b730dbbd9","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e99fbbcd5859211b730dbbd9: start","job_status":"start","queue_duration_s":1.609631,"scheduling_latency_s":1.609659} gitlab # [ 322.619901] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e99fbbcd5859211b730dbbd9","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e99fbbcd5859211b730dbbd9: done: 0.020875 sec","job_status":"done","queue_duration_s":1.609631,"scheduling_latency_s":1.609659,"redis_calls":13,"redis_duration_s":0.0033950000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001355,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00204,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020875,"completed_at":"2026-09-04T07:29:06.389Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.661461] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2746a5fb74a2b45c8bb85adc","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2746a5fb74a2b45c8bb85adc: start","job_status":"start","queue_duration_s":1.63243,"scheduling_latency_s":1.632457} gitlab # [ 322.674708] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2746a5fb74a2b45c8bb85adc","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2746a5fb74a2b45c8bb85adc: done: 0.02078 sec","job_status":"done","queue_duration_s":1.63243,"scheduling_latency_s":1.632457,"redis_calls":13,"redis_duration_s":0.0035700000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001155,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002415,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02078,"completed_at":"2026-09-04T07:29:06.412Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.718265] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f0ed7d3791ab3bb8c3b37f3","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f0ed7d3791ab3bb8c3b37f3: start","job_status":"start","queue_duration_s":1.654962,"scheduling_latency_s":1.654986} gitlab # [ 322.731575] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f0ed7d3791ab3bb8c3b37f3","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f0ed7d3791ab3bb8c3b37f3: done: 0.019128 sec","job_status":"done","queue_duration_s":1.654962,"scheduling_latency_s":1.654986,"redis_calls":13,"redis_duration_s":0.002849,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001829,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019128,"completed_at":"2026-09-04T07:29:06.433Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.772606] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4a465bae1a09d4d86efdcef","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4a465bae1a09d4d86efdcef: start","job_status":"start","queue_duration_s":1.677422,"scheduling_latency_s":1.677448} gitlab # [ 322.785463] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f4a465bae1a09d4d86efdcef","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f4a465bae1a09d4d86efdcef: done: 0.02025 sec","job_status":"done","queue_duration_s":1.677422,"scheduling_latency_s":1.677448,"redis_calls":13,"redis_duration_s":0.0031739999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02025,"completed_at":"2026-09-04T07:29:06.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.827533] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"421850e5eb16c2d826313e11","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-421850e5eb16c2d826313e11: start","job_status":"start","queue_duration_s":1.69945,"scheduling_latency_s":1.699475} gitlab # [ 322.840858] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"421850e5eb16c2d826313e11","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-421850e5eb16c2d826313e11: done: 0.020133 sec","job_status":"done","queue_duration_s":1.69945,"scheduling_latency_s":1.699475,"redis_calls":13,"redis_duration_s":0.003223,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001089,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002134,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020133,"completed_at":"2026-09-04T07:29:06.479Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.882747] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec5f10170fbdc942cff271ea","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec5f10170fbdc942cff271ea: start","job_status":"start","queue_duration_s":1.721372,"scheduling_latency_s":1.721398} gitlab # [ 322.895802] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec5f10170fbdc942cff271ea","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec5f10170fbdc942cff271ea: done: 0.035071 sec","job_status":"done","queue_duration_s":1.721372,"scheduling_latency_s":1.721398,"redis_calls":13,"redis_duration_s":0.012568000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.008701,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015028,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035071,"completed_at":"2026-09-04T07:29:06.515Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.939138] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5237145bad4d4f7c3afb5243","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5237145bad4d4f7c3afb5243: start","job_status":"start","queue_duration_s":1.760366,"scheduling_latency_s":1.760398} gitlab # [ 322.952590] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5237145bad4d4f7c3afb5243","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5237145bad4d4f7c3afb5243: done: 0.021273 sec","job_status":"done","queue_duration_s":1.760366,"scheduling_latency_s":1.760398,"redis_calls":13,"redis_duration_s":0.002402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000855,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001547,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021273,"completed_at":"2026-09-04T07:29:06.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 322.993405] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5feaa755469b85ed488d156","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5feaa755469b85ed488d156: start","job_status":"start","queue_duration_s":1.78341,"scheduling_latency_s":1.783438} gitlab # [ 323.006577] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.563Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5feaa755469b85ed488d156","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5feaa755469b85ed488d156: done: 0.020585 sec","job_status":"done","queue_duration_s":1.78341,"scheduling_latency_s":1.783438,"redis_calls":13,"redis_duration_s":0.002291,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001402,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020585,"completed_at":"2026-09-04T07:29:06.563Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.048400] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"511b4b75477def978288cfd3","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-511b4b75477def978288cfd3: start","job_status":"start","queue_duration_s":1.805629,"scheduling_latency_s":1.805658} gitlab # [ 323.061641] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"511b4b75477def978288cfd3","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-511b4b75477def978288cfd3: done: 0.0211 sec","job_status":"done","queue_duration_s":1.805629,"scheduling_latency_s":1.805658,"redis_calls":13,"redis_duration_s":0.002399,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001468,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0211,"completed_at":"2026-09-04T07:29:06.586Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.103731] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4a2f06c69f03038e69af58d","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4a2f06c69f03038e69af58d: start","job_status":"start","queue_duration_s":1.829862,"scheduling_latency_s":1.829891} gitlab # [ 323.118382] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b4a2f06c69f03038e69af58d","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b4a2f06c69f03038e69af58d: done: 0.021584 sec","job_status":"done","queue_duration_s":1.829862,"scheduling_latency_s":1.829891,"redis_calls":13,"redis_duration_s":0.0030440000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021584,"completed_at":"2026-09-04T07:29:06.610Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.159266] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94d4517b81620ab4a53329c8","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94d4517b81620ab4a53329c8: start","job_status":"start","queue_duration_s":1.853101,"scheduling_latency_s":1.85313} gitlab # [ 323.172579] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94d4517b81620ab4a53329c8","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94d4517b81620ab4a53329c8: done: 0.021584 sec","job_status":"done","queue_duration_s":1.853101,"scheduling_latency_s":1.85313,"redis_calls":13,"redis_duration_s":0.002683,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001803,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014723,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021584,"completed_at":"2026-09-04T07:29:06.634Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.213630] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2756015cbb0c294fc685bcc6","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2756015cbb0c294fc685bcc6: start","job_status":"start","queue_duration_s":1.876378,"scheduling_latency_s":1.876406} gitlab # [ 323.226625] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2756015cbb0c294fc685bcc6","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2756015cbb0c294fc685bcc6: done: 0.020343 sec","job_status":"done","queue_duration_s":1.876378,"scheduling_latency_s":1.876406,"redis_calls":13,"redis_duration_s":0.002243,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001417,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020343,"completed_at":"2026-09-04T07:29:06.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.268761] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3dc0ad43d7d353d9e8cfe608","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3dc0ad43d7d353d9e8cfe608: start","job_status":"start","queue_duration_s":1.898346,"scheduling_latency_s":1.898373} gitlab # [ 323.282130] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3dc0ad43d7d353d9e8cfe608","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3dc0ad43d7d353d9e8cfe608: done: 0.020498 sec","job_status":"done","queue_duration_s":1.898346,"scheduling_latency_s":1.898373,"redis_calls":13,"redis_duration_s":0.002326,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000846,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00148,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020498,"completed_at":"2026-09-04T07:29:06.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.325333] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13065ae251d4fb594b1ebe48","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13065ae251d4fb594b1ebe48: start","job_status":"start","queue_duration_s":1.921539,"scheduling_latency_s":1.921565} gitlab # [ 323.338531] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13065ae251d4fb594b1ebe48","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13065ae251d4fb594b1ebe48: done: 0.01882 sec","job_status":"done","queue_duration_s":1.921539,"scheduling_latency_s":1.921565,"redis_calls":13,"redis_duration_s":0.002058,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001436,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01278,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01882,"completed_at":"2026-09-04T07:29:06.699Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.380523] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.701Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3454838089950849455b20a","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3454838089950849455b20a: start","job_status":"start","queue_duration_s":1.941685,"scheduling_latency_s":1.941709} gitlab # [ 323.393696] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3454838089950849455b20a","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3454838089950849455b20a: done: 0.01815 sec","job_status":"done","queue_duration_s":1.941685,"scheduling_latency_s":1.941709,"redis_calls":13,"redis_duration_s":0.001863,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01815,"completed_at":"2026-09-04T07:29:06.719Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.434166] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cf4e4853c6fd131b81d8efa","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cf4e4853c6fd131b81d8efa: start","job_status":"start","queue_duration_s":1.961269,"scheduling_latency_s":1.961294} gitlab # [ 323.447154] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4cf4e4853c6fd131b81d8efa","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4cf4e4853c6fd131b81d8efa: done: 0.018704 sec","job_status":"done","queue_duration_s":1.961269,"scheduling_latency_s":1.961294,"redis_calls":13,"redis_duration_s":0.00189,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000678,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018704,"completed_at":"2026-09-04T07:29:06.739Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.487523] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1707697e1f8c35338d58b5","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1707697e1f8c35338d58b5: start","job_status":"start","queue_duration_s":1.982288,"scheduling_latency_s":1.982316} gitlab # [ 323.500529] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1707697e1f8c35338d58b5","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1707697e1f8c35338d58b5: done: 0.018873 sec","job_status":"done","queue_duration_s":1.982288,"scheduling_latency_s":1.982316,"redis_calls":13,"redis_duration_s":0.00201,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000758,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001252,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018873,"completed_at":"2026-09-04T07:29:06.760Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.542073] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1519c3dee5e66ec29dd6c1e3","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1519c3dee5e66ec29dd6c1e3: start","job_status":"start","queue_duration_s":2.002618,"scheduling_latency_s":2.002645} gitlab # [ 323.554877] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1519c3dee5e66ec29dd6c1e3","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1519c3dee5e66ec29dd6c1e3: done: 0.019375 sec","job_status":"done","queue_duration_s":2.002618,"scheduling_latency_s":2.002645,"redis_calls":13,"redis_duration_s":0.00205,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001304,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019375,"completed_at":"2026-09-04T07:29:06.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.595341] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae40e8e1cc2407d08f9edf5b","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae40e8e1cc2407d08f9edf5b: start","job_status":"start","queue_duration_s":2.023633,"scheduling_latency_s":2.023658} gitlab # [ 323.608305] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.803Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae40e8e1cc2407d08f9edf5b","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae40e8e1cc2407d08f9edf5b: done: 0.020741 sec","job_status":"done","queue_duration_s":2.023633,"scheduling_latency_s":2.023658,"redis_calls":13,"redis_duration_s":0.002086,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001308,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020741,"completed_at":"2026-09-04T07:29:06.803Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.651442] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d666e23402b5fe97539060e","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d666e23402b5fe97539060e: start","job_status":"start","queue_duration_s":2.045851,"scheduling_latency_s":2.045878} gitlab # [ 323.665069] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d666e23402b5fe97539060e","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d666e23402b5fe97539060e: done: 0.019034 sec","job_status":"done","queue_duration_s":2.045851,"scheduling_latency_s":2.045878,"redis_calls":13,"redis_duration_s":0.001833,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001146,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019034,"completed_at":"2026-09-04T07:29:06.824Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.706343] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b019ea8c2dddae3191112fc","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b019ea8c2dddae3191112fc: start","job_status":"start","queue_duration_s":2.066454,"scheduling_latency_s":2.06648} gitlab # [ 323.720379] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b019ea8c2dddae3191112fc","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b019ea8c2dddae3191112fc: done: 0.018932 sec","job_status":"done","queue_duration_s":2.066454,"scheduling_latency_s":2.06648,"redis_calls":13,"redis_duration_s":0.001962,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001213,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012892,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018932,"completed_at":"2026-09-04T07:29:06.844Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 323.763711] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.846Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"807635eb38f028e51f064bac","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-807635eb38f028e51f064bac: start","job_status":"start","queue_duration_s":2.086885,"scheduling_latency_s":2.086912} gitlab # [ 323.776883] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:06.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"807635eb38f028e51f064bac","created_at":"2026-09-04T07:29:04.674Z","trace_propagation_headers":{"sentry-trace":"4eafc56ae28b4efc8b0e4cb24aea5058-132620ebd45244d6","baggage":"sentry-trace_id=4eafc56ae28b4efc8b0e4cb24aea5058,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"169f1d45900ca6ed01e7b0180ed4203c","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-04T07:29:04.759Z","job_size_bytes":2,"pid":2072,"sidekiq_tid":"m7ok","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-807635eb38f028e51f064bac: done: 0.018998 sec","job_status":"done","queue_duration_s":2.086885,"scheduling_latency_s":2.086912,"redis_calls":13,"redis_duration_s":0.002055,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000796,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001259,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018998,"completed_at":"2026-09-04T07:29:06.865Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 363.544946] postgres[3601]: [3601] ERROR: relation "table_without_models" does not exist gitlab # [ 363.545596] postgres[3601]: [3601] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 369.641075] runuser[3179]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 369.642185] setup-gitlab-start[3165]: + systemctl restart gitlab-sidekiq.service gitlab # [ 369.678977] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 369.680614] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:54.565Z","message":"Shutting down"} gitlab # [ 369.682287] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:54.565Z","message":"Scheduler exiting..."} gitlab # [ 369.683997] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:54.566Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 369.686014] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:54.567Z","message":"Scheduler exiting..."} gitlab # [ 370.183099] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:55.068Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 372.688180] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:57.573Z","message":"Bye!"} gitlab # [ 372.732500] sidekiq-cluster[2072]: {"severity":"INFO","time":"2026-09-04T07:29:57.618Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2072,"worker_id":"sidekiq_0","memwd_rss_bytes":919699456,"retry":0} gitlab # [ 373.979966] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 373.980431] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 373.980687] systemd[1]: gitlab-sidekiq.service: Consumed 2min 10.348s CPU time over 4min 4.518s wall clock time, 938M memory peak, 4.6M read from disk. gitlab # [ 373.994409] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 373.999205] setup-gitlab-start[3165]: + mkdir -p /var/lib/secrets gitlab # [ 374.004928] setup-gitlab-start[3165]: + echo nixbot-test-token-of-20-chars gitlab # [ 374.007937] setup-gitlab-start[3165]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 374.011932] setup-gitlab-start[3165]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 375.624184] gitaly[930]: time="2026-09-04T07:30:00.509Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:10.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:00.508" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 375.624667] gitaly[930]: time="2026-09-04T07:30:00.509Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:10.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:00.508" grpc.time_ms=0.389 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 375.977665] gitaly[930]: time="2026-09-04T07:30:00.863Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:10.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:00.863" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 376.010782] gitaly[930]: time="2026-09-04T07:30:00.864Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:10.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:00.863" grpc.time_ms=0.628 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 376.111649] gitaly[930]: time="2026-09-04T07:30:00.997Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V diskcache=789fa07b-499b-419a-90ca-bcdcfd8905a1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:30:10.057" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:00.919" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 376.140727] gitaly[930]: time="2026-09-04T07:30:00.998Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=43 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1441 command.oublock=32 command.real_time_ms=51 command.spawn_token_fork_ms=10 command.system_time_ms=37 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:30:10.057" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:00.919" grpc.time_ms=79.163 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 376.166951] gitaly[930]: time="2026-09-04T07:30:01.031Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:11.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:01.030" pid=930 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 376.182270] gitaly[930]: time="2026-09-04T07:30:01.032Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:11.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:01.030" grpc.time_ms=1.642 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 376.197586] gitaly[930]: time="2026-09-04T07:30:01.063Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:30:11.021" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:01.042" grpc.time_ms=19.728 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 376.325046] gitaly[930]: time="2026-09-04T07:30:01.211Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:11.189" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:01.210" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 376.356931] gitaly[930]: time="2026-09-04T07:30:01.211Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:11.189" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:01.210" grpc.time_ms=0.664 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 376.394187] gitaly[930]: time="2026-09-04T07:30:01.264Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V diskcache=a9ff1d06-1294-407d-91e5-63f96c208283 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:30:11.195" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:01.215" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 376.418113] gitaly[930]: time="2026-09-04T07:30:01.265Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=24 command.spawn_token_fork_ms=4 command.system_time_ms=9 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-04T07:30:11.195" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:01.215" grpc.time_ms=49.153 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 376.441477] gitaly[930]: time="2026-09-04T07:30:01.277Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:11.255" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:01.276" pid=930 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 376.456283] gitaly[930]: time="2026-09-04T07:30:01.277Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:11.255" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:01.276" grpc.time_ms=1.316 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 376.470439] gitaly[930]: time="2026-09-04T07:30:01.297Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:30:11.263" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:01.284" grpc.time_ms=12.786 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 376.487888] gitaly[930]: time="2026-09-04T07:30:01.361Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-04T07:30:11.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:01.360" grpc.time_ms=0.368 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 376.501091] gitaly[930]: time="2026-09-04T07:30:01.376Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:30:11.023" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:01.374" grpc.time_ms=0.79 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 377.540842] gitaly[930]: time="2026-09-04T07:30:02.425Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN624H6Y63Y87EC73ES27V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:30:12.055" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:02.406" grpc.time_ms=18.692 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 378.378274] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:03 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 4333 gitlab # [ 378.381183] setup-gitlab-start[3165]: + mkdir -p /tmp/test-flake gitlab # [ 378.388354] setup-gitlab-start[3165]: + cd /tmp/test-flake gitlab # [ 378.390432] setup-gitlab-start[3165]: + git init -b master gitlab # [ 378.462843] setup-gitlab-start[3733]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 378.464628] setup-gitlab-start[3165]: + git config user.name test gitlab # [ 378.467774] setup-gitlab-start[3165]: + git config user.email test@example.com gitlab # [ 378.472631] setup-gitlab-start[3165]: + cat gitlab # [ 378.477334] setup-gitlab-start[3165]: + git add flake.nix gitlab # [ 378.483004] setup-gitlab-start[3165]: + git commit -m 'initial commit' gitlab # [ 378.520740] setup-gitlab-start[3738]: [master (root-commit) e3c9397] initial commit gitlab # [ 378.522003] setup-gitlab-start[3738]: 1 file changed, 10 insertions(+) gitlab # [ 378.522923] setup-gitlab-start[3738]: create mode 100644 flake.nix gitlab # [ 378.523860] setup-gitlab-start[3165]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 378.529661] setup-gitlab-start[3165]: + git push -u origin master gitlab # [ 378.644164] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:03 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 79 gitlab # [ 378.870620] gitaly[930]: time="2026-09-04T07:30:03.756Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN66MCE535KHBRPT7XRKG6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:03.743" grpc.time_ms=11.968 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 378.888132] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:03 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 225 gitlab # [ 379.801773] gitaly[930]: time="2026-09-04T07:30:04.688Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:30:14.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:04.671" grpc.time_ms=15.907 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 379.896161] gitaly[930]: time="2026-09-04T07:30:04.781Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:30:34.061" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:30:04.762" grpc.time_ms=18.956 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 379.972165] gitaly[930]: time="2026-09-04T07:30:04.858Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 duration_ms=843ns method=POST pid=930 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 380.040847] gitaly[930]: time="2026-09-04T07:30:04.927Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 duration_ms=67ns method=POST pid=930 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 380.049897] gitaly[930]: time="2026-09-04T07:30:04.927Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:04.014" grpc.time_ms=913.505 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 380.108494] gitaly[930]: time="2026-09-04T07:30:04.994Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:04.992" grpc.time_ms=2.042 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 380.166635] gitaly[930]: time="2026-09-04T07:30:05.052Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:05.051" grpc.time_ms=0.909 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 380.226655] gitaly[930]: time="2026-09-04T07:30:05.112Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:05.111" grpc.time_ms=1.004 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 380.441120] gitaly[930]: time="2026-09-04T07:30:05.327Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-04T07:30:15.286" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:05.307" grpc.time_ms=19.554 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 380.501382] gitaly[930]: time="2026-09-04T07:30:05.387Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=32 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1433 command.oublock=0 command.real_time_ms=39 command.spawn_token_fork_ms=5 command.system_time_ms=18 command.user_time_ms=14 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-04T07:30:15.001" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:05.342" grpc.time_ms=44.228 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 380.540803] gitaly[930]: time="2026-09-04T07:30:05.427Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 duration_ms=257ns method=POST pid=930 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 380.551441] gitaly[930]: time="2026-09-04T07:30:05.428Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:05.168" grpc.time_ms=260.004 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 380.582271] gitaly[930]: time="2026-09-04T07:30:05.468Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 diskcache=52f46332-0cd0-4f3e-a392-7327549b0006 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:03.930" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 380.603451] gitaly[930]: time="2026-09-04T07:30:05.469Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=336 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13794 command.oublock=32 command.real_time_ms=1527 command.spawn_token_fork_ms=1 command.system_time_ms=202 command.user_time_ms=134 component=gitaly.StreamServerInterceptor correlation_id=01M1NN66VZX3KD17Z07N9T4ED9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:03.930" grpc.time_ms=1538.038 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 380.626835] systemd[1]: Finished setup-gitlab.service. gitlab # [ 380.628293] setup-gitlab-start[3742]: To http://gitlab/root/test-flake.git gitlab # [ 380.629612] setup-gitlab-start[3742]: * [new branch] master -> master gitlab # [ 380.630905] setup-gitlab-start[3742]: branch 'master' set up to track 'origin/master'. gitlab # [ 380.632891] gitlab-workhorse[820]: time="2026-09-04T07:30:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 380.635457] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:05 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1694 gitlab # [ 380.638093] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 382.10 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 382.319233] sidekiq-cluster[3672]: {"severity":"INFO","time":"2026-09-04T07:30:07.159Z","message":"Starting cluster with 1 processes"} gitlab # [ 382.358950] nixbot[3832]: {"ts": "2026-09-04T07:30:07.244Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 382.406033] nixbot[3832]: {"ts": "2026-09-04T07:30:07.292Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 382.446145] nixbot[3832]: {"ts": "2026-09-04T07:30:07.332Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 382.453507] nixbot[3832]: {"ts": "2026-09-04T07:30:07.339Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 382.460881] nixbot[3832]: {"ts": "2026-09-04T07:30:07.347Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 382.473463] nixbot[3832]: {"ts": "2026-09-04T07:30:07.359Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 382.480591] nixbot[3832]: {"ts": "2026-09-04T07:30:07.366Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 382.487172] nixbot[3832]: {"ts": "2026-09-04T07:30:07.369Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 382.494758] nixbot[3832]: {"ts": "2026-09-04T07:30:07.380Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 382.501446] nixbot[3832]: {"ts": "2026-09-04T07:30:07.384Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 382.508202] nixbot[3832]: {"ts": "2026-09-04T07:30:07.392Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 382.516295] nixbot[3832]: {"ts": "2026-09-04T07:30:07.402Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 382.523639] nixbot[3832]: {"ts": "2026-09-04T07:30:07.407Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 382.531013] nixbot[3832]: {"ts": "2026-09-04T07:30:07.411Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 382.537469] nixbot[3832]: {"ts": "2026-09-04T07:30:07.418Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 382.544103] nixbot[3832]: {"ts": "2026-09-04T07:30:07.421Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 382.551000] nixbot[3832]: {"ts": "2026-09-04T07:30:07.425Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 382.556885] nixbot[3832]: {"ts": "2026-09-04T07:30:07.428Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 382.562135] nixbot[3832]: {"ts": "2026-09-04T07:30:07.435Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 382.567313] nixbot[3832]: {"ts": "2026-09-04T07:30:07.439Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 382.572609] nixbot[3832]: {"ts": "2026-09-04T07:30:07.442Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 382.577655] nixbot[3832]: {"ts": "2026-09-04T07:30:07.453Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 382.583083] nixbot[3832]: {"ts": "2026-09-04T07:30:07.457Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 382.587902] nixbot[3832]: {"ts": "2026-09-04T07:30:07.462Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 382.592880] nixbot[3832]: {"ts": "2026-09-04T07:30:07.465Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 382.597583] nixbot[3832]: {"ts": "2026-09-04T07:30:07.471Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"} gitlab # [ 382.602124] nixbot[3832]: {"ts": "2026-09-04T07:30:07.475Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"} gitlab # [ 382.606443] nixbot[3832]: {"ts": "2026-09-04T07:30:07.478Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"} gitlab # [ 382.610364] nixbot[3832]: {"ts": "2026-09-04T07:30:07.481Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"} gitlab # [ 382.620270] nixbot[3832]: {"ts": "2026-09-04T07:30:07.506Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"} gitlab # [ 382.625260] nixbot[3832]: {"ts": "2026-09-04T07:30:07.511Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"} gitlab # [ 383.052490] nixbot[3832]: INFO: Started server process [3832] gitlab # [ 383.055384] nixbot[3832]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 383.086720] nixbot[3832]: INFO: ::ffff:127.0.0.1:40326 - "GET /health HTTP/1.1" 200 OK gitlab # [ 383.106018] systemd[1]: Started nixbot CI service. gitlab # [ 383.108504] systemd[1]: Reached target Multi-User System. gitlab # [ 383.110943] systemd[1]: Startup finished in 724ms (kernel) + 4.308s (initrd) + 6min 18.075s (userspace) = 6min 23.108s. gitlab # [ 383.460163] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:08 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 372 gitlab # [ 383.468705] nixbot[3832]: {"ts": "2026-09-04T07:30:08.347Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 383.501229] nixbot[3832]: {"ts": "2026-09-04T07:30:08.387Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 383.710654] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 198 gitlab # [ 383.713732] nixbot[3832]: {"ts": "2026-09-04T07:30:08.599Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 383.718158] nixbot[3832]: {"ts": "2026-09-04T07:30:08.604Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab: (finished: waiting for unit nixbot.service, in 2.12 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 383.819085] nixbot[3832]: INFO: ::ffff:127.0.0.1:40340 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 383.963797] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 95 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.15 seconds) gitlab # [ 383.990044] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 265 gitlab # [ 383.993407] nixbot[3832]: {"ts": "2026-09-04T07:30:08.878Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.20 seconds) (finished: subtest: project discovered and webhook registered, in 1.35 seconds) subtest: push delivers the webhook gitlab # [ 385.169768] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 138 gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 385.301535] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:10 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 56 gitlab # [ 385.438841] gitaly[930]: time="2026-09-04T07:30:10.324Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN6D4FQ3H6VT7R1XKBDCVA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:10.311" grpc.time_ms=12.329 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 385.454260] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:10 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 137 gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 136.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 385.838646] gitaly[930]: time="2026-09-04T07:30:10.724Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN6D9XJVCD8QJPDTGVXBSD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-04T07:30:40.012" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-04T07:30:10.714" grpc.time_ms=10.608 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 385.909263] gitaly[930]: time="2026-09-04T07:30:10.795Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1NN6D9XJVCD8QJPDTGVXBSD duration_ms=218ns method=POST pid=930 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 385.973506] gitaly[930]: time="2026-09-04T07:30:10.859Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1NN6D9XJVCD8QJPDTGVXBSD duration_ms=63ns method=POST pid=930 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 385.991651] gitaly[930]: time="2026-09-04T07:30:10.860Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN6D9XJVCD8QJPDTGVXBSD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:10.575" grpc.time_ms=284.486 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 386.026031] gitaly[930]: time="2026-09-04T07:30:10.912Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN6D9XJVCD8QJPDTGVXBSD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:10.911" grpc.time_ms=0.657 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 386.067829] gitaly[930]: time="2026-09-04T07:30:10.954Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN6D9XJVCD8QJPDTGVXBSD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:10.953" grpc.time_ms=0.951 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 386.106317] gitaly[930]: time="2026-09-04T07:30:10.992Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN6D9XJVCD8QJPDTGVXBSD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:10.991" grpc.time_ms=0.558 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 386.232213] gitaly[930]: time="2026-09-04T07:30:11.118Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1NN6D9XJVCD8QJPDTGVXBSD duration_ms=77ns method=POST pid=930 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 386.243336] gitaly[930]: time="2026-09-04T07:30:11.120Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN6D9XJVCD8QJPDTGVXBSD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:11.038" grpc.time_ms=81.706 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # To http://gitlab/root/test-flake.git gitlab # [ 386.276087] gitaly[930]: time="2026-09-04T07:30:11.140Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1NN6D9XJVCD8QJPDTGVXBSD diskcache=2057f4a9-6d7d-43e4-b47d-d33f2f41f396 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:10.484" pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # e3c9397..3e2ad0d master -> master gitlab # [ 386.300154] gitlab-workhorse[820]: time="2026-09-04T07:30:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 386.303873] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:11 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 775 gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.14 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51' gitlab # [ 386.307996] gitaly[930]: time="2026-09-04T07:30:11.140Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=224 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13694 command.oublock=32 command.real_time_ms=645 command.spawn_token_fork_ms=4 command.system_time_ms=117 command.user_time_ms=107 component=gitaly.StreamServerInterceptor correlation_id=01M1NN6D9XJVCD8QJPDTGVXBSD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:10.484" grpc.time_ms=656.424 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', in 0.11 seconds) gitlab # [ 386.427943] nixbot[3832]: INFO: ::ffff:127.0.0.1:40350 - "GET /api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 HTTP/1.1" 200 OK gitlab # [ 387.204265] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:12 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 3198 gitlab # [ 387.205757] nixbot[3832]: {"ts": "2026-09-04T07:30:12.091Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 387.369909] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 149 gitlab # [ 387.372434] nixbot[3832]: {"ts": "2026-09-04T07:30:12.258Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', in 0.07 seconds) gitlab # [ 387.497163] nixbot[3832]: INFO: ::ffff:127.0.0.1:40362 - "GET /api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 HTTP/1.1" 200 OK gitlab # [ 387.553724] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:12 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 172 gitlab # [ 387.557879] nixbot[3832]: {"ts": "2026-09-04T07:30:12.442Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 387.748593] gitaly[930]: time="2026-09-04T07:30:12.633Z" level=info msg="finished unary call with code OK" catfile.duration_ms=7 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=7 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6FB87SG6JPNX8CX933BB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-04T07:30:42.001" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=255 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:12.602" grpc.time_ms=29.895 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.793945] gitaly[930]: time="2026-09-04T07:30:12.680Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6FB87SG6JPNX8CX933BB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:42.077" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:12.678" grpc.time_ms=1.49 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.847655] gitaly[930]: time="2026-09-04T07:30:12.733Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=588 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6FB87SG6JPNX8CX933BB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-04T07:30:22.043" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:12.713" grpc.time_ms=19.769 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 387.911483] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 772 "" "python-httpx/0.28.1" 340 gitlab # [ 387.919080] nixbot[3832]: {"ts": "2026-09-04T07:30:12.799Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 388.132228] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 209 gitlab # [ 388.138401] nixbot[3832]: {"ts": "2026-09-04T07:30:13.020Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 388.144855] nixbot[3832]: {"ts": "2026-09-04T07:30:13.029Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 388.370513] gitaly[930]: time="2026-09-04T07:30:13.256Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M1NN6FZPG3J7Q8YKHE85XCZF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:13.242" grpc.time_ms=14.013 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 388.401185] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 146 gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51' gitlab # [ 388.621314] nixbot[3832]: INFO: ::ffff:127.0.0.1:40378 - "GET /api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', in 0.14 seconds) gitlab # [ 388.711588] gitaly[930]: time="2026-09-04T07:30:13.594Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6G4BABTPY9S7R5AXJ4BE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:13.579" pid=930 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 388.748032] gitlab-workhorse[820]: time="2026-09-04T07:30:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 388.750050] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 336 gitlab # [ 388.754489] gitaly[930]: time="2026-09-04T07:30:13.594Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6G4BABTPY9S7R5AXJ4BE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:13.579" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 388.775042] gitaly[930]: time="2026-09-04T07:30:13.594Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6G4BABTPY9S7R5AXJ4BE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:13.579" grpc.time_ms=14.951 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 388.897142] gitaly[930]: time="2026-09-04T07:30:13.782Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6GFME8CAYKQZYXDCSPMK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:13.744" pid=930 remote_ip="2001:db8:1::1" request_sha=46a8bf005c411f206f88fba98fbbc4c6b16fc429 response_bytes=418 span.kind=server system=grpc gitlab # [ 388.939625] gitlab-workhorse[820]: time="2026-09-04T07:30:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=418 gitlab # [ 388.944923] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 418 "" "git/2.55.0" 162 gitlab # [ 388.947067] gitaly[930]: time="2026-09-04T07:30:13.782Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1133 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=1 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6GFME8CAYKQZYXDCSPMK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:13.744" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 388.963465] gitaly[930]: time="2026-09-04T07:30:13.782Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1133 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=1 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6GFME8CAYKQZYXDCSPMK grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:13.744" grpc.time_ms=37.652 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 389.429358] gitaly[930]: time="2026-09-04T07:30:14.315Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=89 command.spawn_token_fork_ms=75 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN6GW37VA40CMEVEKECK3Y grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:14.223" grpc.time_ms=91.756 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 389.447869] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:14 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 299 gitlab # [ 389.607745] gitaly[930]: time="2026-09-04T07:30:14.493Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6H5TBZB5E99TBQMZCDR8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:14.472" pid=930 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51' gitlab # [ 389.630181] gitaly[930]: time="2026-09-04T07:30:14.494Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=13 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6H5TBZB5E99TBQMZCDR8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:14.472" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 389.649380] gitlab-workhorse[820]: time="2026-09-04T07:30:14Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 389.652660] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:14 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 164 gitlab # [ 389.655702] gitaly[930]: time="2026-09-04T07:30:14.494Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=13 command.system_time_ms=1 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6H5TBZB5E99TBQMZCDR8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:14.472" grpc.time_ms=22.176 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 389.691883] nixbot[3832]: INFO: ::ffff:127.0.0.1:40382 - "GET /api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', in 0.05 seconds) gitlab # [ 390.066223] gitaly[930]: time="2026-09-04T07:30:14.951Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NN6HDRHYG2KPGFT15T24XA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:14.935" grpc.time_ms=16.098 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 390.084118] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:14 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 368 gitlab # [ 390.238995] gitaly[930]: time="2026-09-04T07:30:15.125Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6HSV9FJTF4ZAC1GD0NW3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:15.102" pid=930 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 390.263896] gitaly[930]: time="2026-09-04T07:30:15.125Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=6 command.system_time_ms=7 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6HSV9FJTF4ZAC1GD0NW3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:15.102" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 390.300221] gitlab-workhorse[820]: time="2026-09-04T07:30:15Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 390.302360] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:15 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 154 gitlab # [ 390.304601] gitaly[930]: time="2026-09-04T07:30:15.125Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=6 command.system_time_ms=7 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6HSV9FJTF4ZAC1GD0NW3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-04T07:30:15.102" grpc.time_ms=23.269 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 390.586690] gitaly[930]: time="2026-09-04T07:30:15.473Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6J3E29FQEBCMRMMHDRYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:45.071" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:15.471" grpc.time_ms=1.089 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51' gitlab # [ 390.688526] gitaly[930]: time="2026-09-04T07:30:15.574Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NN6J3E29FQEBCMRMMHDRYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-04T07:30:45.149" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:15.550" grpc.time_ms=23.766 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 390.749715] gitaly[930]: time="2026-09-04T07:30:15.636Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1NN6J3E29FQEBCMRMMHDRYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:30:25.011" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:15.621" grpc.time_ms=14.173 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 390.769382] nixbot[3832]: INFO: ::ffff:127.0.0.1:40392 - "GET /api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', in 0.08 seconds) (finished: subtest: push delivers the webhook, in 5.60 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses gitlab # [ 390.797303] gitaly[930]: time="2026-09-04T07:30:15.683Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1NN6J3E29FQEBCMRMMHDRYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:30:25.055" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:15.665" grpc.time_ms=17.452 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 391.036554] gitaly[930]: time="2026-09-04T07:30:15.920Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6JGMNRYH4Q1YK8PQ8ZXC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:45.218" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:15.919" grpc.time_ms=0.731 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 391.108650] gitaly[930]: time="2026-09-04T07:30:15.994Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6J3E29FQEBCMRMMHDRYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-04T07:30:25.023" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:15.993" grpc.time_ms=0.407 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses, in 0.50 seconds) gitlab # [ 391.253977] gitaly[930]: time="2026-09-04T07:30:16.140Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=0 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=9 command.system_time_ms=0 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6J3E29FQEBCMRMMHDRYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-04T07:30:26.008" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:16.049" grpc.time_ms=90.792 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 391.277839] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses HTTP/1.1" 200 2 "" "curl/8.21.0" 454 gitlab # [ 391.342868] gitaly[930]: time="2026-09-04T07:30:16.228Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN6J3E29FQEBCMRMMHDRYN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:16.228" grpc.time_ms=0.57 pid=930 span.kind=server system=grpc gitlab # [ 391.387005] gitaly[930]: time="2026-09-04T07:30:16.273Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1NN6J3E29FQEBCMRMMHDRYN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-04T07:30:16.272" grpc.time_ms=0.543 pid=930 span.kind=server system=grpc gitlab # [ 391.459714] gitaly[930]: time="2026-09-04T07:30:16.339Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6J3E29FQEBCMRMMHDRYN diskcache=90d4fc39-622a-4c95-b30a-e5e56c4373e9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:30:26.126" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:16.167" pid=930 ref=refs/keep-around/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 remote_ip="2001:db8:1::1" revision=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 span.kind=server system=grpc username=root gitlab # [ 391.483629] gitaly[930]: time="2026-09-04T07:30:16.339Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=84 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5071 command.oublock=8 command.real_time_ms=122 command.spawn_token_fork_ms=5 command.system_time_ms=36 command.user_time_ms=48 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6J3E29FQEBCMRMMHDRYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-04T07:30:26.126" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-04T07:30:16.167" grpc.time_ms=172.469 pid=930 ref=refs/keep-around/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 remote_ip="2001:db8:1::1" revision=3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 span.kind=server system=grpc username=root gitlab # [ 391.503835] gitaly[930]: time="2026-09-04T07:30:16.358Z" level=info msg="finished unary call with code OK" catfile.duration_ms=12 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=12 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6J3E29FQEBCMRMMHDRYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:46.044" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:16.345" grpc.time_ms=13.32 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 391.871887] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:16 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 1479 gitlab # [ 391.875478] nixbot[3832]: {"ts": "2026-09-04T07:30:16.759Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 \"HTTP/1.1 201 Created\""} gitlab # [ 391.905768] nixbot[3832]: {"ts": "2026-09-04T07:30:16.791Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-3e2ad0d2287d-0"} gitlab # [ 392.173758] nixbot[3832]: {"ts": "2026-09-04T07:30:17.059Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-3e2ad0d2287d-0", "argv0": "bwrap"} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses gitlab # [ 392.322257] systemd[1]: Started Nix Daemon. gitlab # [ 392.407816] nix-daemon[4086]: accepted connection from pid 4077, user nixbot gitlab # [ 392.409667] gitaly[930]: time="2026-09-04T07:30:17.295Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6KZSWMSCGB1X1MVKT3ZS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:47.093" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:17.294" grpc.time_ms=0.867 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 392.459583] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 134 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses, in 0.19 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses gitlab # [ 393.661854] gitaly[930]: time="2026-09-04T07:30:18.547Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6N5BDENK1KP4NWZGXTBE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:48.045" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:18.546" grpc.time_ms=1.114 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 393.959631] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 432 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses, in 0.50 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses gitlab # [ 395.146970] gitaly[930]: time="2026-09-04T07:30:20.032Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6PM8DBXMQPACY73A0B8F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:50.029" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:20.030" grpc.time_ms=1.476 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 395.217803] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 190 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses, in 0.26 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses gitlab # [ 396.414521] gitaly[930]: time="2026-09-04T07:30:21.299Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6QW7HZ8VV9B3E8Y3B8Y3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:51.098" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:21.298" grpc.time_ms=0.745 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 396.468114] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:21 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 161 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses, in 0.25 seconds) gitlab # [ 396.808641] nix-daemon[4086]: accepted connection from pid 4117, user nixbot gitlab # [ 396.831620] nix-daemon[4086]: accepted connection from pid 4077, user nixbot gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses gitlab # [ 397.666939] gitaly[930]: time="2026-09-04T07:30:22.552Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6S32WYFEEJ1S5P98NBC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:52.049" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:22.551" grpc.time_ms=0.843 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 397.758576] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:22 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 209 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses, in 0.29 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses gitlab # [ 398.890474] gitaly[930]: time="2026-09-04T07:30:23.775Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6TA8P22QYM7ZAC5JVWDD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:53.472" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:23.772" grpc.time_ms=2.894 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 398.946323] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 143 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses, in 0.19 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses gitlab # [ 400.112292] gitaly[930]: time="2026-09-04T07:30:24.998Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6VFMW5G5MS95SM52M1CE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:54.290" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:24.991" grpc.time_ms=0.912 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 400.167833] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:25 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 168 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses, in 0.23 seconds) gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses gitlab # [ 401.351989] gitaly[930]: time="2026-09-04T07:30:26.235Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6WNTAMZF76JGK10V8AR1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:56.034" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:26.234" grpc.time_ms=0.921 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses, in 0.27 seconds) gitlab # [ 401.442282] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 220 gitlab # [ 401.538309] nix-daemon[4086]: accepted connection from pid 4077, user nixbot gitlab # [ 401.761118] gitaly[930]: time="2026-09-04T07:30:26.645Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6X2JV75ZYJHZP7QD5N86 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:56.143" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:26.643" grpc.time_ms=1.4 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 401.883462] gitaly[930]: time="2026-09-04T07:30:26.769Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=8 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN6X2JV75ZYJHZP7QD5N86 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:30:36.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:26.755" grpc.time_ms=13.83 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 402.044267] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:26 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 415 gitlab # [ 402.048311] nixbot[3832]: {"ts": "2026-09-04T07:30:26.933Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 \"HTTP/1.1 201 Created\""} gitlab # [ 402.165284] gitaly[930]: time="2026-09-04T07:30:27.051Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6XFVFYN7AFQM3WKMB6AJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:57.049" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:27.050" grpc.time_ms=0.897 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 402.260337] gitaly[930]: time="2026-09-04T07:30:27.146Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN6XFVFYN7AFQM3WKMB6AJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:30:37.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:27.132" grpc.time_ms=13.637 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 402.426072] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 372 gitlab # [ 402.430852] nixbot[3832]: {"ts": "2026-09-04T07:30:27.313Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 \"HTTP/1.1 201 Created\""} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses gitlab # [ 402.692902] gitaly[930]: time="2026-09-04T07:30:27.575Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6XWFXSF2RMES84D67GZA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:57.068" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:27.569" grpc.time_ms=5.322 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 402.815981] gitaly[930]: time="2026-09-04T07:30:27.702Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=9 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1NN6XWFXSF2RMES84D67GZA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-04T07:30:37.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-04T07:30:27.680" grpc.time_ms=21.71 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 402.967711] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:27 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 509 gitlab # [ 402.975590] nixbot[3832]: {"ts": "2026-09-04T07:30:27.858Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51 \"HTTP/1.1 201 Created\""} gitlab # [ 403.001185] gitaly[930]: time="2026-09-04T07:30:27.887Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1NN6XY0QSFHADAXM7Z3CHP2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-04T07:30:57.585" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-04T07:30:27.886" grpc.time_ms=1.098 pid=930 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 403.089171] gitlab-workhorse[820]: gitlab 2001:db8:1::1 - - [2026/09/04:07:30:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 582 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51/statuses, in 0.65 seconds) (finished: subtest: eval and build post commit statuses, in 12.33 seconds) (finished: run the VM test script, in 478.93 seconds) test script finished in 479.05s cleanup kill QemuMachine (pid 46) gitlab # qemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14) (finished: cleanup, in 3.05 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-04T07:30:08.831Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': True, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [{'id': 1, 'project_id': 1, 'number': 1, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-09-04T07:30:15.260035Z', 'started_at': None, 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': {'position': 1, 'blocked_by': []}}] [] [{'id': 1, 'sha': '3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:30:16.656Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:30:16.656Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:30:16.656Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:30:16.656Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:30:16.656Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:30:16.656Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:30:16.656Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'waiting for evaluation', 'created_at': '2026-09-04T07:30:16.656Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 1, 'sha': '3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-04T07:30:16.656Z', 'started_at': None, 'finished_at': '2026-09-04T07:30:26.847Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': '3e2ad0d2287d9ed73af786da8b2f2e5ecc3c6d51', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': '0 attributes built', 'created_at': '2026-09-04T07:30:27.203Z', 'started_at': None, 'finished_at': '2026-09-04T07:30:27.764Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]