tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.1sZ07yAMGt', fmt=raw size=1073741824 (finished: start all VMs, in 71.56 seconds) gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab: waiting for unit setup-gitlab.service gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for the VM to finish booting gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab # Filesystem UUID: 83623822-316c-4a88-971e-e1f81d6d3163 gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] KASLR enabled gitlab # [ 0.000000] random: crng init done gitlab # [ 0.000000] Machine model: linux,dummy-virt gitlab # [ 0.000000] efi: UEFI not found. gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf] gitlab # [ 0.000000] Zone ranges: gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff] gitlab # [ 0.000000] DMA32 empty gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.000000] Device empty gitlab # [ 0.000000] Movable zone start for each node gitlab # [ 0.000000] Early memory node ranges gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe000000 gitlab # [ 0.000000] psci: probing for conduit method from DT. gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware. gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs gitlab # [ 0.000000] psci: Trusted OS migration not required gitlab # [ 0.000000] psci: SMC Calling Convention v1.1 gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 gitlab # [ 0.000000] Detected PIPT I-cache on CPU0 gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface gitlab # [ 0.000000] CPU features: detected: Spectre-v4 gitlab # [ 0.000000] CPU features: detected: Spectre-BHB gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 gitlab # [ 0.000000] alternatives: applying boot alternatives gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/5w83zniyjqw2jjk0sr1sa3mzy9qvb2i4-nixos-system-gitlab-test/init regInfo=/nix/store/avswk2wv479ayg4mky8jnanmmm7rjrc1-closure-info/registration console=ttyAMA0,115200n8 console=tty0 gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/avswk2wv479ayg4mky8jnanmmm7rjrc1-closure-info/registration", will be passed to user space. gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.000000] software IO TLB: area num 4. gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB) gitlab # [ 0.000000] Fallback order for Node 0: 0 gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1572864 gitlab # [ 0.000000] Policy zone: Normal gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.000000] allocated 12582912 bytes of page_ext gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups gitlab # [ 0.000000] rcu: Hierarchical RCU implementation. gitlab # [ 0.000000] rcu: RCU event tracing is enabled. gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.000000] Rude variant of Tasks RCU enabled. gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled. gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 gitlab # [ 0.000000] GICv3: 256 SPIs implemented gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000 gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f50000 gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns gitlab # [ 0.000028] arm-pv: using stolen time PV gitlab # [ 0.000370] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.000544] Console: colour dummy device 80x25 gitlab # [ 0.000551] printk: legacy console [tty0] enabled gitlab # [ 0.000756] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) gitlab # [ 0.000763] pid_max: default: 32768 minimum: 301 gitlab # [ 0.000841] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.000971] landlock: Up and running. gitlab # [ 0.000974] Yama: becoming mindful. gitlab # [ 0.001382] LSM support for eBPF active gitlab # [ 0.001581] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.001689] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.002963] cacheinfo: Unable to detect cache hierarchy for CPU 0 gitlab # [ 0.003646] rcu: Hierarchical SRCU implementation. gitlab # [ 0.003650] rcu: Max phase no-delay instances is 1000. gitlab # [ 0.003806] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.004854] fsl-mc MSI: its@8080000 domain created gitlab # [ 0.004948] EFI services will not be available. gitlab # [ 0.005112] smp: Bringing up secondary CPUs ... gitlab # [ 0.005752] Detected PIPT I-cache on CPU1 gitlab # [ 0.005854] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000 gitlab # [ 0.005988] GICv3: CPU1: using allocated LPI pending table @0x0000000100f60000 gitlab # [ 0.006118] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40] gitlab # [ 0.007272] Detected PIPT I-cache on CPU2 gitlab # [ 0.007381] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000 gitlab # [ 0.007513] GICv3: CPU2: using allocated LPI pending table @0x0000000100f70000 gitlab # [ 0.007641] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40] gitlab # [ 0.008692] Detected PIPT I-cache on CPU3 gitlab # [ 0.008808] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000 gitlab # [ 0.008941] GICv3: CPU3: using allocated LPI pending table @0x0000000100f80000 gitlab # [ 0.009070] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40] gitlab # [ 0.009583] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.009611] SMP: Total of 4 processors activated. gitlab # [ 0.009614] CPU: All CPU(s) started at EL1 gitlab # [ 0.009624] CPU features: detected: Branch Target Identification gitlab # [ 0.009628] CPU features: detected: ARMv8.4 Translation Table Level gitlab # [ 0.009631] CPU features: detected: Instruction cache invalidation not required for I/D coherence gitlab # [ 0.009634] CPU features: detected: Data cache clean to the PoU not required for I/D coherence gitlab # [ 0.009637] CPU features: detected: Common not Private translations gitlab # [ 0.009640] CPU features: detected: CRC32 instructions gitlab # [ 0.009642] CPU features: detected: Data cache clean to Point of Deep Persistence gitlab # [ 0.009646] CPU features: detected: Data cache clean to Point of Persistence gitlab # [ 0.009649] CPU features: detected: Data independent timing control (DIT) gitlab # [ 0.009651] CPU features: detected: E0PD gitlab # [ 0.009653] CPU features: detected: Enhanced Counter Virtualization gitlab # [ 0.009656] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) gitlab # [ 0.009659] CPU features: detected: Enhanced Virtualization Traps gitlab # [ 0.009662] CPU features: detected: Fine Grained Traps gitlab # [ 0.009665] CPU features: detected: Generic authentication (architected QARMA5 algorithm) gitlab # [ 0.009669] CPU features: detected: RCpc load-acquire (LDAPR) gitlab # [ 0.009671] CPU features: detected: LSE atomic instructions gitlab # [ 0.009674] CPU features: detected: Privileged Access Never gitlab # [ 0.009676] CPU features: detected: PMUv3 gitlab # [ 0.009678] CPU features: detected: RAS Extension Support gitlab # [ 0.009681] CPU features: detected: RASv1p1 Extension Support gitlab # [ 0.009683] CPU features: detected: Random Number Generator gitlab # [ 0.009685] CPU features: detected: Speculation barrier (SB) gitlab # [ 0.009688] CPU features: detected: Stage-2 Force Write-Back gitlab # [ 0.009690] CPU features: detected: TLB range maintenance instructions gitlab # [ 0.009694] CPU features: detected: Speculative Store Bypassing Safe (SSBS) gitlab # [ 0.009832] alternatives: applying system-wide alternatives gitlab # [ 0.012722] CPU features: detected: BBM Level 2 without TLB conflict abort gitlab # [ 0.012907] Memory: 5963980K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved) gitlab # [ 0.014372] devtmpfs: initialized gitlab # [ 0.018312] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.018389] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.018577] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL gitlab # [ 0.018582] 0 pages in range for non-PLT usage gitlab # [ 0.018583] 508288 pages in range for PLT usage gitlab # [ 0.018698] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.019431] DMI not present or invalid. gitlab # [ 0.022935] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.025474] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.025762] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.027648] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.027671] audit: initializing netlink subsys (disabled) gitlab # [ 0.028004] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.028509] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.028512] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.028516] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.028519] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.028522] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.028614] cpuidle: using governor ladder gitlab # [ 0.028679] cpuidle: using governor menu gitlab # [ 0.028896] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. gitlab # [ 0.029112] ASID allocator initialised with 65536 entries gitlab # [ 0.030276] Serial: AMBA PL011 UART driver gitlab # [ 0.035385] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 gitlab # [ 0.035711] printk: console [ttyAMA0] enabled gitlab # [ 0.041957] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.041980] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.041990] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages gitlab # [ 0.041998] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page gitlab # [ 0.042007] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.042014] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.042023] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages gitlab # [ 0.042031] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page gitlab # [ 0.054897] fbcon: Taking over console gitlab # [ 0.054929] ACPI: Interpreter disabled. gitlab # [ 0.057779] iommu: Default domain type: Translated gitlab # [ 0.057790] iommu: DMA domain TLB invalidation policy: strict mode gitlab # [ 0.064815] SCSI subsystem initialized gitlab # [ 0.065673] usbcore: registered new interface driver usbfs gitlab # [ 0.065770] usbcore: registered new interface driver hub gitlab # [ 0.065822] usbcore: registered new device driver usb gitlab # [ 0.066738] pps_core: LinuxPPS API ver. 1 registered gitlab # [ 0.066748] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti gitlab # [ 0.066768] PTP clock support registered gitlab # [ 0.066866] EDAC MC: Ver: 3.0.0 gitlab # [ 0.067415] scmi_core: SCMI protocol bus registered gitlab # [ 0.068622] FPGA manager framework gitlab # [ 0.070635] vgaarb: loaded gitlab # [ 0.073264] clocksource: Switched to clocksource arch_sys_counter gitlab # [ 0.079654] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.079715] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.080408] netfs: FS-Cache loaded gitlab # [ 0.080616] pnp: PnP ACPI: disabled gitlab # [ 0.091076] NET: Registered PF_INET protocol family gitlab # [ 0.093561] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.145467] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.145533] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.145590] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.145941] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.146738] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.146848] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.146924] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.147087] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.147333] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.147405] NET: Registered PF_XDP protocol family gitlab # [ 0.147422] PCI: CLS 0 bytes, default 64 gitlab # [ 0.147759] Trying to unpack rootfs image as initramfs... gitlab # [ 0.161517] kvm [1]: HYP mode not available gitlab # [ 0.232345] Initialise system trusted keyrings gitlab # [ 0.232812] workingset: timestamp_bits=42 max_order=21 bucket_order=0 gitlab # [ 0.233697] squashfs: version 4.0 (2009/01/31) Phillip Lougher gitlab # [ 0.233834] 9p: Installing v9fs 9p2000 file system support gitlab # [ 0.249054] Key type asymmetric registered gitlab # [ 0.249060] Asymmetric key parser 'x509' registered gitlab # [ 0.249121] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) gitlab # [ 0.249481] io scheduler mq-deadline registered gitlab # [ 0.249498] io scheduler kyber registered gitlab # [ 0.264895] pl061_gpio 9030000.pl061: PL061 GPIO chip registered gitlab # [ 0.269456] ledtrig-cpu: registered to indicate activity on CPUs gitlab # [ 0.270132] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: gitlab # [ 0.270156] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 gitlab # [ 0.270172] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 gitlab # [ 0.270183] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 gitlab # [ 0.270215] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits gitlab # [ 0.270249] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] gitlab # [ 0.270384] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 gitlab # [ 0.270397] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.270405] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] gitlab # [ 0.270411] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] gitlab # [ 0.270417] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] gitlab # [ 0.270592] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.271523] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.271932] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.271956] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.272006] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.272029] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.272984] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.273411] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.273441] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.273492] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.274516] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.274889] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.274913] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.274963] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.275915] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.276310] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.276332] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.276382] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.277403] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.277796] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.277818] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.277869] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.278826] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.279212] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.279234] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.279299] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.280248] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.280633] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.280656] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.280714] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.280737] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.281795] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint gitlab # [ 0.282204] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.282254] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.283225] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.283658] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.283715] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.284554] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint gitlab # [ 0.284949] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] gitlab # [ 0.285495] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.285968] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] gitlab # [ 0.285991] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.286040] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.287034] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.287420] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.287442] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.287499] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.288679] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned gitlab # [ 0.288692] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned gitlab # [ 0.288699] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned gitlab # [ 0.288788] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned gitlab # [ 0.288870] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned gitlab # [ 0.288954] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned gitlab # [ 0.289036] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned gitlab # [ 0.289134] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned gitlab # [ 0.289226] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned gitlab # [ 0.289334] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned gitlab # [ 0.289418] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned gitlab # [ 0.289510] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned gitlab # [ 0.289626] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned gitlab # [ 0.289711] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned gitlab # [ 0.289745] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned gitlab # [ 0.289787] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned gitlab # [ 0.289819] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned gitlab # [ 0.289853] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned gitlab # [ 0.289887] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned gitlab # [ 0.289922] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned gitlab # [ 0.289956] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned gitlab # [ 0.289991] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned gitlab # [ 0.290025] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned gitlab # [ 0.290060] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned gitlab # [ 0.290097] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned gitlab # [ 0.290130] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned gitlab # [ 0.290163] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned gitlab # [ 0.290205] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned gitlab # [ 0.290238] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned gitlab # [ 0.290278] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned gitlab # [ 0.290318] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned gitlab # [ 0.290358] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned gitlab # [ 0.290391] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned gitlab # [ 0.290426] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned gitlab # [ 0.290474] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] gitlab # [ 0.290484] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] gitlab # [ 0.290489] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] gitlab # [ 0.293000] pci 0000:00:0a.0: enabling device (0000 -> 0002) gitlab # [ 0.327372] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) gitlab # [ 0.333222] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) gitlab # [ 0.339226] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) gitlab # [ 0.345468] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) gitlab # [ 0.351489] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) gitlab # [ 0.357641] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) gitlab # [ 0.363934] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) gitlab # [ 0.370543] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) gitlab # [ 0.376473] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) gitlab # [ 0.382871] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) gitlab # [ 0.389836] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) gitlab # [ 0.404771] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.408987] msm_serial: driver initialized gitlab # [ 0.409358] SuperH (H)SCI(F) driver initialized gitlab # [ 0.409478] STM32 USART driver initialized gitlab # [ 0.454841] loop: module loaded gitlab # [ 0.455362] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 0.460871] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 0.465704] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 0.470767] virtio_blk virtio5: [vdb] 12283512 512-byte logical blocks (6.29 GB/5.86 GiB) gitlab # [ 0.476092] megasas: 07.734.00.00-rc1 gitlab # [ 0.478060] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] gitlab # [ 0.483953] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.483994] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.489577] Using buffer write method gitlab # [ 0.489642] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] gitlab # [ 0.494272] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.494307] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.499192] Using buffer write method gitlab # [ 0.499228] Concatenating MTD devices: gitlab # [ 0.499236] (0): "0.flash" gitlab # [ 0.499242] (1): "0.flash" gitlab # [ 0.499248] into device "0.flash" gitlab # [ 0.587443] Freeing initrd memory: 27184K gitlab # [ 0.608296] tun: Universal TUN/TAP device driver, 1.6 gitlab # [ 0.617489] thunder_xcv, ver 1.0 gitlab # [ 0.617581] thunder_bgx, ver 1.0 gitlab # [ 0.617644] nicpf, ver 1.0 gitlab # [ 0.619314] e1000: Intel(R) PRO/1000 Network Driver gitlab # [ 0.619325] e1000: Copyright (c) 1999-2006 Intel Corporation. gitlab # [ 0.619387] e1000e: Intel(R) PRO/1000 Network Driver gitlab # [ 0.619401] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. gitlab # [ 0.619464] igb: Intel(R) Gigabit Ethernet Network Driver gitlab # [ 0.619474] igb: Copyright (c) 2007-2014 Intel Corporation. gitlab # [ 0.619552] igbvf: Intel(R) Gigabit Virtual Function Network Driver gitlab # [ 0.619562] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. gitlab # [ 0.619951] sky2: driver version 1.30 gitlab # [ 0.624682] usbcore: registered new interface driver usb-storage gitlab # [ 0.624900] ehci-pci 0000:00:0a.0: EHCI Host Controller gitlab # [ 0.624943] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 gitlab # [ 0.625024] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.625060] usbserial: USB Serial support registered for generic gitlab # [ 0.625661] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 gitlab # [ 0.626870] hv_vmbus: registering driver hyperv_keyboard gitlab # [ 0.629611] rtc-pl031 9010000.pl031: registered as rtc0 gitlab # [ 0.629669] rtc-pl031 9010000.pl031: setting system clock to 2026-09-03T10:26:15 UTC (1788431175) gitlab # [ 0.630629] i2c_dev: i2c /dev entries driver gitlab # [ 0.637371] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 gitlab # [ 0.638453] hub 1-0:1.0: USB hub found gitlab # [ 0.638638] hub 1-0:1.0: 6 ports detected gitlab # [ 0.638982] sdhci: Secure Digital Host Controller Interface driver gitlab # [ 0.639000] sdhci: Copyright(c) Pierre Ossman gitlab # [ 0.639830] Synopsys Designware Multimedia Card Interface Driver gitlab # [ 0.640992] sdhci-pltfm: SDHCI platform and OF driver helper gitlab # [ 0.645851] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 0.646847] usbcore: registered new interface driver usbhid gitlab # [ 0.646859] usbhid: USB HID core driver gitlab # [ 0.655773] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available gitlab # [ 0.660430] drop_monitor: Initializing network drop monitor service gitlab # [ 0.660780] NET: Registered PF_INET6 protocol family gitlab # [ 0.662953] Segment Routing with IPv6 gitlab # [ 0.662988] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.663132] NET: Registered PF_PACKET protocol family gitlab # [ 0.663452] 9pnet: Installing 9P2000 support gitlab # [ 0.667028] Key type dns_resolver registered gitlab # [ 0.681047] registered taskstats version 1 gitlab # [ 0.681455] Loading compiled-in X.509 certificates gitlab # [ 0.697195] Demotion targets for Node 0: null gitlab # [ 0.697422] Key type .fscrypt registered gitlab # [ 0.697429] Key type fscrypt-provisioning registered gitlab # [ 0.697589] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 0.697613] ima: Allocated hash algorithm: sha1 gitlab # [ 0.697643] ima: No architecture policies found gitlab # [ 0.698797] input: gpio-keys as /devices/platform/gpio-keys/input/input0 gitlab # [ 0.726123] clk: Disabling unused clocks gitlab # [ 0.726154] PM: genpd: Disabling unused power domains gitlab # [ 0.730852] Freeing unused kernel memory: 4736K gitlab # [ 0.731068] Run /init as init process gitlab # [ 0.763349] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 0.889335] usb 1-1: new high-speed USB device number 2 using ehci-pci gitlab # [ 1.046088] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 gitlab # [ 1.097788] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.097854] systemd[1]: Detected virtualization qemu. gitlab # [ 1.097995] systemd[1]: Detected architecture arm64. gitlab # [ 1.098012] systemd[1]: Running in initrd. gitlab # [ 1.098842] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.099091] systemd[1]: Hostname set to . gitlab # [ 1.177960] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 gitlab # [ 1.297343] usb 1-2: new high-speed USB device number 3 using ehci-pci gitlab # [ 1.457394] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.462634] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 gitlab # [ 1.468797] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 gitlab # [ 1.563043] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.594849] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.595314] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.595381] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.595409] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.595459] systemd[1]: Reached target Path Units. gitlab # [ 1.595493] systemd[1]: Reached target Slice Units. gitlab # [ 1.595530] systemd[1]: Reached target Swaps. gitlab # [ 1.595568] systemd[1]: Reached target Timer Units. gitlab # [ 1.595891] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.596258] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.596580] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.596898] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.597078] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.597124] systemd[1]: Reached target Socket Units. gitlab # [ 1.600463] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.603943] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.604080] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 1.607728] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 1.631955] systemd[1]: Starting Journal Service... gitlab # [ 1.638229] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.638549] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.649560] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 1.654373] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 1.656474] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.657242] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.658036] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 1.662308] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 1.687797] systemd-journald[96]: Collecting audit messages is disabled. gitlab # [ 1.691887] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 1.696027] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 1.697377] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 gitlab # [ 1.697615] [drm] features: -virgl +edid -resource_blob -host_visible gitlab # [ 1.697620] [drm] features: -context_init gitlab # [ 1.698894] [drm] number of scanouts: 1 gitlab # [ 1.698914] [drm] number of cap sets: 0 gitlab # [ 1.704553] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 1.705556] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic gitlab # [ 1.705568] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 gitlab # [ 1.712628] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.713436] Console: switching to colour frame buffer device 160x50 gitlab # [ 1.720649] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device gitlab # [ 1.741896] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.748603] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.757296] systemd-modules-load[97]: Using 4 probe threads gitlab # [ 1.759704] systemd[1]: Started Journal Service. gitlab # [ 1.761724] systemd-modules-load[97]: Module 'virtio_balloon' is built in gitlab # [ 1.764122] systemd-modules-load[97]: Module 'virtio_console' is built in gitlab # [ 1.765460] systemd-modules-load[97]: Module 'virtio_rng' is built in gitlab # [ 1.766863] systemd-modules-load[97]: Inserted module 'dm_mod' gitlab # [ 1.767887] systemd-modules-load[97]: Inserted module 'virtio_gpu' gitlab # [ 1.769001] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.770118] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.771166] systemd[1]: Reached target Local File Systems. gitlab # [ 1.779360] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.780690] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.806000] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.810899] systemd[1]: Finished Create System Files and Directories. gitlab # [ 1.817278] systemd-udevd[108]: Using default interface naming scheme 'v261'. gitlab # [ 1.831736] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 1.858307] systemd[1]: Starting Virtual Console Setup... gitlab # [ 1.919662] systemd-vconsole-setup[128]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 1.924809] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.287044] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.289722] systemd[1]: Reached target System Initialization. gitlab # [ 2.292208] systemd[1]: Reached target Basic System. gitlab # [ 2.466481] (udev-worker)[145]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.472295] (udev-worker)[117]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.475836] (udev-worker)[117]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.530540] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.548071] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.551241] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.553765] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.594930] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.598785] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.651757] systemd[1]: Mounting /sysroot... gitlab # [ 2.695320] EXT4-fs (vda): mounted filesystem 83623822-316c-4a88-971e-e1f81d6d3163 r/w with ordered data mode. Quota mode: none. gitlab # [ 2.697798] systemd[1]: Mounted /sysroot. gitlab # [ 2.698731] systemd[1]: Reached target Initrd Root File System. gitlab # [ 2.702178] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 2.705980] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 2.722561] systemd[1]: Mounting /sysroot/run... gitlab # [ 2.725397] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 2.731049] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 2.732896] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 2.739861] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 2.742360] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 2.747170] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 2.751001] systemd[1]: Mounted /sysroot/run. gitlab # [ 2.751907] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 2.754579] systemd-sysroot-fstab-check[165]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 2.772982] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 2.774320] systemd[1]: Reload requested from client PID 165 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 2.776872] systemd[1]: Reloading... gitlab # [ 2.892662] systemd[1]: Reloading finished in 115 ms. gitlab # [ 2.947485] systemd-sysroot-fstab-check[165]: Requesting initrd-fs.target/start/replace... gitlab # [ 2.949429] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 2.950290] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 2.952062] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 2.953753] systemd-sysroot-fstab-check[165]: Requesting swap.target/start/replace... gitlab # [ 2.959113] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 2.960125] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 2.961108] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 2.962036] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 2.979155] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 2.980535] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.093907] (udev-worker)[144]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory gitlab # [ 3.096260] (udev-worker)[144]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory gitlab # [ 3.108243] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.110534] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.111324] systemd[1]: Stopping Virtual Console Setup... gitlab # [ 3.112114] systemd[1]: Starting Virtual Console Setup... gitlab # [ 3.128816] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.129899] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.130631] systemd[1]: Starting Virtual Console Setup... gitlab # [ 3.152257] systemd-vconsole-setup[196]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 3.154344] systemd[1]: Finished Virtual Console Setup. gitlab # [ 3.658237] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.732354] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.734614] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.737409] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.739774] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.786016] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.789552] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.802357] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.804890] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.807303] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 3.858661] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 3.861295] systemd[1]: Stopped target Basic System. gitlab # [ 3.863392] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 3.865743] systemd[1]: Stopped target Path Units. gitlab # [ 3.867759] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 3.870955] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 3.874208] systemd[1]: Stopped target Slice Units. gitlab # [ 3.876331] systemd[1]: Stopped target Socket Units. gitlab # [ 3.880384] systemd[1]: Stopped target System Initialization. gitlab # [ 3.883920] systemd[1]: Stopped target Swaps. gitlab # [ 3.887190] systemd[1]: Stopped target Timer Units. gitlab # [ 3.892242] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 3.894771] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 3.900718] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 3.903704] systemd[1]: Stopped Find NixOS closure. gitlab # [ 3.905877] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 3.907937] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.909926] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 3.911992] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 3.913934] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 3.916107] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 3.917598] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 3.919791] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 3.921970] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 3.923822] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 3.925591] systemd[1]: Stopped target Local File Systems. gitlab # [ 3.926937] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 3.928673] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 3.930406] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 3.931743] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 3.933651] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.935387] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.936584] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 3.937993] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 3.939315] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 3.940826] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 3.942035] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.943418] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.944616] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 3.945884] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 3.947220] systemd[1]: systemd-udevd.service: Consumed 2.220s CPU time over 2.136s wall clock time, 31M memory peak. gitlab # [ 3.949230] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 3.950540] systemd[1]: Closed udev Control Socket. gitlab # [ 3.951471] systemd[1]: Starting Cleanup udev Database... gitlab # [ 3.952521] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 3.953895] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 3.954996] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 3.957491] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 3.958709] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 3.959905] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.011663] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.014874] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.017111] systemd[1]: Reached target Switch Root. gitlab # [ 4.019157] systemd[1]: Starting NixOS Activation... gitlab # [ 4.224263] initrd-nixos-activation-start[221]: booting system configuration /nix/store/5w83zniyjqw2jjk0sr1sa3mzy9qvb2i4-nixos-system-gitlab-test gitlab # [ 4.293913] initrd-nixos-activation-start[221]: running activation script... gitlab # [ 4.625288] initrd-nixos-activation-start[244]: setting up /etc... gitlab # [ 4.800008] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.803282] systemd[1]: Finished NixOS Activation. gitlab # [ 4.805497] systemd[1]: Starting Switch Root... gitlab # [ 4.859323] systemd[1]: Switching root. gitlab # [ 4.969583] systemd-journald[96]: Received SIGTERM from PID 1 (systemd). gitlab # [ 5.602328] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.602470] systemd[1]: Detected virtualization qemu. gitlab # [ 5.602551] systemd[1]: Detected architecture arm64. gitlab # [ 5.602743] systemd[1]: Detected first boot. gitlab # [ 5.604092] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.856819] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.965571] systemd[1]: Applying preset policy. gitlab # [ 6.163360] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 6.311894] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 6.312270] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 6.314430] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 6.319083] systemd[1]: Created slice Slice /system/getty. gitlab # [ 6.325388] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 6.328720] systemd[1]: Created slice User and Session Slice. gitlab # [ 6.328932] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 6.333810] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 6.334831] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 6.335572] systemd[1]: Expecting device /dev/ttyAMA0... gitlab # [ 6.336267] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 6.336977] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 6.337934] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 6.339015] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 6.340140] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 6.341242] systemd[1]: Reached target Path Units. gitlab # [ 6.342345] systemd[1]: Reached target Remote File Systems. gitlab # [ 6.343403] systemd[1]: Reached target Slice Units. gitlab # [ 6.344491] systemd[1]: Reached target Swaps. gitlab # [ 6.348438] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 6.352656] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 6.355722] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 6.359348] systemd[1]: Listening on Factory Reset Management. gitlab # [ 6.360640] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 6.368780] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 6.370872] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 6.372738] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 6.373448] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 6.374192] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.374856] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 6.377726] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 6.378342] systemd[1]: Listening on udev Control Socket. gitlab # [ 6.379077] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 6.385599] systemd[1]: Mounting Huge Pages File System... gitlab # [ 6.392143] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 6.401435] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 6.411506] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 6.421955] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 6.435937] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 6.436952] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 6.443393] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.444443] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 6.445632] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.451106] systemd[1]: Starting Load Kernel Module fuse... gitlab # [ 6.452250] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.459128] systemd[1]: Starting Journal Service... gitlab # [ 6.465774] systemd[1]: Starting Load Kernel Modules... gitlab # [ 6.474694] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 6.492834] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 6.494991] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.495479] fuse: init (API version 7.45) gitlab # [ 6.500684] systemd-journald[315]: Collecting audit messages is enabled. gitlab # [ 6.503109] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 6.508741] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 6.512975] systemd[1]: Mounted Huge Pages File System. gitlab # [ 6.515110] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 6.517133] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 6.519097] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 6.521364] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 6.522864] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 6.523971] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 6.524992] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 6.526167] systemd[1]: modprobe@fuse.service: Deactivated successfully. gitlab # [ 6.527255] systemd[1]: Finished Load Kernel Module fuse. gitlab # [ 6.528092] systemd[1]: Started Journal Service. gitlab # [ 6.526157] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 6.534229] EXT4-fs (vda): re-mounted 83623822-316c-4a88-971e-e1f81d6d3163. gitlab # [ 6.532978] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 6.535990] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 6.537836] systemd-modules-load[316]: Using 3 probe threads gitlab # [ 6.539189] systemd-modules-load[316]: Module 'atkbd' is built in gitlab # [ 6.540675] systemd-modules-load[316]: Module 'loop' is built in gitlab # [ 6.542057] systemd-modules-load[316]: Inserted module 'tls' gitlab # [ 6.547219] systemd[1]: Finished Load Kernel Modules. gitlab # [ 6.548547] systemd[1]: Mounting FUSE Control File System... gitlab # [ 6.549874] systemd[1]: Starting Firewall... gitlab # [ 6.551341] systemd-oomd[318]: No swap; memory pressure usage will be degraded gitlab # [ 6.553407] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 6.554676] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 6.556401] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 6.559571] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 6.564172] systemd[1]: Mounted FUSE Control File System. gitlab # [ 6.577679] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 6.581421] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 6.583088] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.585464] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.586722] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.613446] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 6.616052] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.620347] systemd-journald[315]: Received client request to flush runtime journal. gitlab # [ 6.646960] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.648217] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 6.649064] systemd[1]: Reached target First Boot Complete. gitlab # [ 6.650409] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 6.653858] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 6.654979] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 6.657149] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 6.713366] systemd-udevd[371]: Using default interface naming scheme 'v261'. gitlab # [ 6.746829] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 6.932163] systemd[1]: Finished Firewall. gitlab # [ 7.141218] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 7.235861] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 7.293540] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 7.333173] (udev-worker)[404]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.340463] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. gitlab # [ 7.349132] (udev-worker)[473]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 7.356441] (udev-worker)[473]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.358744] systemd[1]: Mounting /run/wrappers... gitlab # [ 7.360107] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 7.362178] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 7.365030] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 7.368763] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 7.371388] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.373977] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.378821] systemd[1]: Mounted /run/wrappers. gitlab # [ 7.382584] systemd[1]: Reached target Local File Systems. gitlab # [ 7.386783] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 7.388405] systemd[1]: Starting register-nix-paths.service... gitlab # [ 7.390757] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 7.391652] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.411401] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 7.414281] systemd[1]: Starting Create System Files and Directories... gitlab # [ 7.455125] systemd[1]: Finished Create System Files and Directories. gitlab # [ 7.456539] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 7.459390] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 7.462260] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 7.468291] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 7.482049] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 7.489130] mousedev: PS/2 mouse device common for all mice gitlab # [ 7.502536] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 7.505881] systemd[1]: Starting Update is Completed... gitlab # [ 7.536644] systemd[1]: Finished Update is Completed. gitlab # [ 7.578403] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 7.580688] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.581625] systemd[1]: suid-sgid-wrappers.service: Consumed 135ms CPU time over 189ms wall clock time, 6.4M memory peak, 1.9M read from disk. gitlab # [ 7.847053] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.848545] systemd[1]: Reached target System Initialization. gitlab # [ 7.850215] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.851984] systemd[1]: Started logrotate.timer. gitlab # [ 7.853112] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.855459] systemd[1]: Reached target Timer Units. gitlab # [ 7.856336] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.857255] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.872131] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.873173] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.874340] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.875164] systemd[1]: Reached target Socket Units. gitlab # [ 7.878148] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.926886] dbus-broker-launch[560]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.928295] dbus-broker-launch[560]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.930526] dbus-broker-launch[560]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.933312] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.944168] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 gitlab # [ 7.947488] dbus-broker-launch[560]: Ready gitlab # [ 7.948367] systemd[1]: Reached target Basic System. gitlab # [ 7.975500] systemd[1]: Started backdoor.service. gitlab # [ 7.978780] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.996306] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 7.997808] systemd[1]: Starting Logrotate configuration check... gitlab # [ 8.003031] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 8.005995] systemd[1]: Starting Post-Boot Actions... gitlab # [ 8.020398] systemd[1]: Started Reset console on configuration changes. gitlab # [ 8.029429] logrotate[567]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 8.031592] logrotate[567]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf gitlab # [ 8.033001] logrotate[567]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 8.036191] logrotate[567]: Reading state from file: /var/lib/logrotate.status gitlab # [ 8.038089] logrotate[567]: state file /var/lib/logrotate.status does not exist gitlab # connecting to host... gitlab # [ 8.042017] logrotate[567]: Allocating hash table for state file, size 64 entries gitlab # [ 8.043201] logrotate[567]: Handling 4 logs gitlab # [ 8.043831] logrotate[567]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 8.053816] logrotate[567]: considering log /var/log/btmp gitlab # [ 8.054563] logrotate[567]: Creating new state gitlab: connected to guest root shell gitlab # [ 8.055137] logrotate[567]: Now: 2026-09-03 10:26 gitlab: (connecting took 8.51 seconds) gitlab # [ 8.055753] logrotate[567]: Last rotated at 2026-09-03 10:00 gitlab: (finished: waiting for the VM to finish booting, in 8.51 seconds) gitlab # [ 8.056533] logrotate[567]: log does not need rotating (log has already been rotated) gitlab # [ 8.057497] logrotate[567]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 8.062298] logrotate[567]: considering log /var/log/wtmp gitlab # [ 8.063251] logrotate[567]: Creating new state gitlab # [ 8.063827] logrotate[567]: Now: 2026-09-03 10:26 gitlab # [ 8.064599] logrotate[567]: Last rotated at 2026-09-03 10:00 gitlab # [ 8.065410] logrotate[567]: log does not need rotating (log has already been rotated) gitlab # [ 8.066420] logrotate[567]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 8.068374] logrotate[567]: switching euid from 0 to 165 and egid from 0 to 165 (pid 567) gitlab # [ 8.069591] logrotate[567]: considering log /var/gitlab/state/log/*.log gitlab # [ 8.070550] logrotate[567]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 8.071699] logrotate[567]: Creating new state gitlab # [ 8.072463] logrotate[567]: switching euid from 165 to 0 and egid from 165 to 0 (pid 567) gitlab # [ 8.073622] logrotate[567]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 8.075269] logrotate[567]: switching euid from 0 to 60 and egid from 0 to 60 (pid 567) gitlab # [ 8.080006] logrotate[567]: considering log /var/log/nginx/*.log gitlab # [ 8.080902] logrotate[567]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 8.081888] logrotate[567]: Creating new state gitlab # [ 8.082553] logrotate[567]: not running postrotate script, since no logs were rotated gitlab # [ 8.083721] logrotate[567]: switching euid from 60 to 0 and egid from 60 to 0 (pid 567) gitlab # [ 8.085189] systemd[1]: Starting resolvconf update... gitlab # [ 8.086075] systemd[1]: Finished Logrotate configuration check. gitlab # [ 8.087248] nsncd[568]: Sep 03 10:26:22.956 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.092215] systemd[1]: Finished Post-Boot Actions. gitlab # [ 8.093214] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 8.094386] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.105918] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.106877] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.112355] systemd[1]: Starting User Login Management... gitlab # [ 8.121579] systemd[1]: Starting Virtual Console Setup... gitlab # [ 8.143637] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 8.145515] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 8.146657] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 8.147845] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 8.149541] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 8.150424] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 8.151252] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 8.152358] systemd[1]: nscd.service: Consumed 28ms CPU time over 148ms wall clock time, 7.6M memory peak, 5.8M read from disk. gitlab # [ 8.166307] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 8.174399] systemd-logind[632]: New seat seat0. gitlab # [ 8.176514] systemd-logind[632]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 8.180114] systemd-logind[632]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) gitlab # [ 8.181487] systemd-logind[632]: Watching system buttons on /dev/input/event0 (gpio-keys) gitlab # [ 8.182594] systemd[1]: Started User Login Management. gitlab # [ 8.186455] systemd[1]: Starting linger-users.service... gitlab # [ 8.190793] systemd-vconsole-setup[637]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 8.196699] systemd[1]: Finished Virtual Console Setup. gitlab # [ 8.204768] nsncd[662]: Sep 03 10:26:23.075 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.207032] systemd[1]: Finished resolvconf update. gitlab # [ 8.207913] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.209192] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 8.210110] systemd[1]: Finished linger-users.service. gitlab # [ 8.210869] systemd[1]: Reached target Preparation for Network. gitlab # [ 8.211674] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.212850] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.213880] systemd[1]: Starting DHCP Client... gitlab # [ 8.215771] systemd[1]: Starting Address configuration of eth1... gitlab # [ 8.220072] systemd[1]: Starting Extra networking commands.... gitlab # [ 8.258738] network-addresses-eth1-start[691]: adding address 192.168.1.1/24... done gitlab # [ 8.261230] network-addresses-eth1-start[691]: adding address 2001:db8:1::1/64... done gitlab # [ 8.268633] systemd[1]: Finished Address configuration of eth1. gitlab # [ 8.303855] dhcpcd[700]: dhcpcd-10.3.2 starting gitlab # [ 8.306154] dhcpcd[751]: dev: loaded udev gitlab # [ 8.315323] systemd[1]: Finished Extra networking commands.. gitlab # [ 8.317168] systemd[1]: Reached target Network. gitlab # [ 8.320177] systemd[1]: Starting gitlab-workhorse.service...[ 8.321089] 8021q: 802.1Q VLAN Support v1.8 gitlab # gitlab # [ 8.321655] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 8.328388] systemd[1]: Starting Nginx Web Server... gitlab # [ 8.333766] systemd[1]: Starting PostgreSQL Server... gitlab # [ 8.338953] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 8.339855] systemd[1]: Starting Permit User Sessions... gitlab # [ 8.351630] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 8.365344] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 8.370068] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 8.370601] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 8.372208] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 8.372530] cfg80211: failed to load regulatory.db gitlab # [ 8.385089] systemd[1]: Finished Permit User Sessions. gitlab # [ 8.396250] systemd[1]: Started Getty on tty1. gitlab # [ 8.397025] systemd[1]: Reached target Login Prompts. gitlab # [ 8.418458] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 8.419203] dhcpcd[751]: eth0: waiting for carrier gitlab # [ 8.419996] dhcpcd[751]: eth0: carrier acquired gitlab # [ 8.422725] dhcpcd[751]: DUID 00:01:00:01:32:2c:07:cf:52:54:00:12:34:56 gitlab # [ 8.423858] dhcpcd[751]: eth0: IAID 00:12:34:56 gitlab # [ 8.425509] dhcpcd[751]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 8.499157] nginx-pre-start[791]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok gitlab # [ 8.501142] nginx-pre-start[791]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful gitlab # [ 8.506483] systemd[1]: Started Nginx Web Server. gitlab # [ 8.532122] redis-server[790]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 8.534589] redis-server[790]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 8.536141] redis-server[790]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=790, just started gitlab # [ 8.538380] postgresql-pre-start[794]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 8.539775] postgresql-pre-start[794]: This user must also own the server process. gitlab # [ 8.540939] postgresql-pre-start[794]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 8.542191] postgresql-pre-start[794]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 8.543534] postgresql-pre-start[794]: The default text search configuration will be set to "english". gitlab # [ 8.544846] postgresql-pre-start[794]: Data page checksums are enabled. gitlab # [ 8.545938] postgresql-pre-start[794]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 8.547259] redis-server[790]: Configuration loaded gitlab # [ 8.548090] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 8.548857] postgresql-pre-start[794]: creating subdirectories ... ok gitlab # [ 8.549693] postgresql-pre-start[794]: selecting dynamic shared memory implementation ... posix gitlab # [ 8.550901] redis[790]: monotonic clock: ARM CNTVCT @ 1000 ticks/us gitlab # [ 8.552095] redis[790]: Running mode=standalone, port=0. gitlab # [ 8.552990] redis[790]: Server initialized gitlab # [ 8.553734] redis[790]: Ready to accept connections unix gitlab # [ 8.554683] redis[790]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 8.583657] postgresql-pre-start[794]: selecting default "max_connections" ... 100 gitlab # [ 8.628894] postgresql-pre-start[794]: selecting default "shared_buffers" ... 128MB gitlab # [ 8.940138] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 9.103568] postgresql-pre-start[794]: selecting default time zone ... UTC gitlab # [ 9.107347] postgresql-pre-start[794]: creating configuration files ... ok gitlab # [ 9.195328] gitlab-workhorse[817]: time="2026-09-03T10:26:24Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 9.199067] gitlab-workhorse[817]: time="2026-09-03T10:26:24Z" level=info msg="Using redis/go-redis" gitlab # [ 9.201845] gitlab-workhorse[817]: time="2026-09-03T10:26:24Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 9.255680] dhcpcd[751]: eth0: soliciting a DHCP lease gitlab # [ 9.272709] dhcpcd[751]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 9.300596] dhcpcd[751]: eth0: probing address 10.0.2.15/24 gitlab # [ 9.343132] postgresql-pre-start[794]: running bootstrap script ... ok gitlab # [ 10.078541] postgresql-pre-start[794]: performing post-bootstrap initialization ... ok gitlab # [ 10.292243] postgresql-pre-start[794]: syncing data to disk ... ok gitlab # [ 10.294332] postgresql-pre-start[794]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 10.295783] postgresql-pre-start[794]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 10.298319] postgresql-pre-start[794]: Success. You can now start the database server using: gitlab # [ 10.299619] postgresql-pre-start[794]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 10.440892] postgres[852]: [852] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 10.446447] postgres[852]: [852] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 10.449700] postgres[852]: [852] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 10.453598] postgres[852]: [852] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 10.460653] postgres[862]: [862] LOG: database system was shut down at 2026-09-03 10:26:24 GMT gitlab # [ 10.471229] postgres[852]: [852] LOG: database system is ready to accept connections gitlab # [ 10.476163] systemd[1]: Started PostgreSQL Server. gitlab # [ 10.481641] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 10.879228] postgresql-setup-start[873]: CREATE DATABASE gitlab # [ 10.930777] postgresql-setup-start[883]: CREATE ROLE gitlab # [ 10.957051] postgresql-setup-start[885]: ALTER DATABASE gitlab # [ 11.008700] postgresql-setup-start[890]: CREATE ROLE gitlab # [ 11.014895] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 11.017166] systemd[1]: Reached target PostgreSQL. gitlab # [ 11.020564] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 11.068260] dhcpcd[751]: eth0: soliciting an IPv6 router gitlab # [ 11.070667] dhcpcd[751]: eth0: Router Advertisement from fe80::2 gitlab # [ 11.073220] dhcpcd[751]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 11.076444] dhcpcd[751]: eth0: adding route to fec0::/64 gitlab # [ 11.078748] dhcpcd[751]: eth0: adding default route via fe80::2 gitlab # [ 11.148862] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[878]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 11.153686] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[878]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 11.243571] gitlab-postgresql-start[898]: CREATE DATABASE gitlab # [ 11.280291] systemd[1]: Finished gitlab-config.service. gitlab # [ 11.293320] systemd[1]: Started gitaly.service. gitlab # [ 11.302620] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 11.330968] gitlab-postgresql-start[913]: CREATE EXTENSION gitlab # [ 11.462550] gitlab-postgresql-start[926]: CREATE EXTENSION gitlab # [ 11.465929] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 12.019671] gitaly[920]: time="2026-09-03T10:26:26.890Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=920 gitlab # [ 12.026661] gitaly[920]: time="2026-09-03T10:26:26.891Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=920 gitlab # [ 12.029665] gitaly[920]: time="2026-09-03T10:26:26.891Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=920 gitlab # [ 12.033315] gitaly[920]: time="2026-09-03T10:26:26.891Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=920 gitlab # [ 12.036226] gitaly[920]: time="2026-09-03T10:26:26.891Z" level=info msg="Starting Gitaly" pid=920 version= gitlab # [ 12.255435] gitaly[920]: time="2026-09-03T10:26:27.126Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=234 pid=920 gitlab # [ 12.259508] gitaly[920]: time="2026-09-03T10:26:27.126Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=920 gitlab # [ 12.264228] gitaly[920]: time="2026-09-03T10:26:27.127Z" level=info msg="finished initializing command factory" duration_ms=0 pid=920 gitlab # [ 12.266584] gitaly[920]: time="2026-09-03T10:26:27.127Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-920/git-exec-1041921997.d/git pid=920 gitlab # [ 12.269595] gitaly[920]: time="2026-09-03T10:26:27.135Z" level=info msg="finished detecting git version" duration_ms=8 pid=920 gitlab # [ 12.271754] gitaly[920]: time="2026-09-03T10:26:27.135Z" level=info msg="using Git version" pid=920 version=2.53.g gitlab # [ 12.273789] gitaly[920]: time="2026-09-03T10:26:27.136Z" level=info msg="clearing disk cache object folder" pid=920 storage=default gitlab # [ 12.276254] gitaly[920]: time="2026-09-03T10:26:27.136Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1096232894 pid=920 storage=default gitlab # [ 12.280470] gitaly[920]: time="2026-09-03T10:26:27.136Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1096232894 pid=920 storage=default gitlab # [ 12.284362] gitaly[920]: time="2026-09-03T10:26:27.136Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=920 gitlab # [ 12.287884] gitaly[920]: time="2026-09-03T10:26:27.136Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=920 gitlab # [ 12.291582] gitaly[920]: time="2026-09-03T10:26:27.136Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1096232894 clear_duration_ms=0 pid=920 storage=default gitlab # [ 12.295560] gitaly[920]: time="2026-09-03T10:26:27.150Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=920 gitlab # [ 12.298507] gitaly[920]: time="2026-09-03T10:26:27.151Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=920 schema=unix gitlab # [ 12.301318] gitaly[920]: time="2026-09-03T10:26:27.151Z" level=info msg="listening at address" address=/run/gitaly/gitaly-920/sock.d/intern pid=920 schema=unix gitlab # [ 12.303972] gitaly[920]: time="2026-09-03T10:26:27.151Z" level=info msg="finished tempdir cleaner walk" pid=920 storage=default time_ms=0 gitlab # [ 12.306383] gitaly[920]: time="2026-09-03T10:26:27.151Z" level=info msg="counting repositories" pid=920 gitlab # [ 12.308165] gitaly[920]: time="2026-09-03T10:26:27.151Z" level=info msg="starting to count repositories" pid=920 storage_path=/var/gitlab/state/repositories gitlab # [ 12.310808] gitaly[920]: time="2026-09-03T10:26:27.151Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=920 storage_path=/var/gitlab/state/repositories gitlab # [ 12.313899] gitaly[920]: time="2026-09-03T10:26:27.151Z" level=info msg="completed counting all repositories" counting_duration=0 pid=920 gitlab # [ 12.316315] gitaly[920]: time="2026-09-03T10:26:27.152Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=920 gitlab # [ 12.318845] gitaly[920]: time="2026-09-03T10:26:27.152Z" level=info msg="Started Gitaly" duration_ms=261 pid=920 gitlab # [ 12.321029] gitaly[920]: time="2026-09-03T10:26:27.152Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=920 gitlab # [ 12.323614] gitaly[920]: time="2026-09-03T10:26:27.153Z" level=info msg="maintenance: daily scheduled" pid=920 scheduled="2026-09-03 12:00:00 +0000 UTC" gitlab # [ 12.605640] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[930]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.615672] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[930]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.625807] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[930]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 13.502696] dhcpcd[751]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 13.505559] dhcpcd[751]: eth0: adding route to 10.0.2.0/24 gitlab # [ 13.508449] dhcpcd[751]: eth0: adding default route via 10.0.2.2 gitlab # [ 13.642915] systemd[1]: Started DHCP Client. gitlab # [ 13.643969] systemd[1]: Reached target Network is Online. gitlab # [ 15.695282] gitaly[920]: time="2026-09-03T10:26:30.565Z" level=info msg="License database preloaded" duration_ms=3674 pid=920 gitlab # [ 56.020123] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[930]: W, [2026-09-03T10:27:10.890322 #930] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 59.051364] postgres[1427]: [1427] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 59.055350] postgres[1427]: [1427] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 59.059181] postgres[1427]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 59.063093] postgres[1427]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 59.066605] postgres[1427]: attidentity AS identity, gitlab # [ 59.069013] postgres[1427]: attgenerated as attgenerated gitlab # [ 59.071460] postgres[1427]: FROM pg_attribute a gitlab # [ 59.073592] postgres[1427]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 59.077309] postgres[1427]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 59.079984] postgres[1427]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 59.084194] postgres[1427]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 59.086999] postgres[1427]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 59.090603] postgres[1427]: ORDER BY a.attnum gitlab # [ 59.092572] postgres[1427]: gitlab # [ 59.258810] gitlab-workhorse[817]: time="2026-09-03T10:27:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 64.270459] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1469]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 64.270884] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1469]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 69.265262] gitlab-workhorse[817]: time="2026-09-03T10:27:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 79.276231] gitlab-workhorse[817]: time="2026-09-03T10:27:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 89.285973] gitlab-workhorse[817]: time="2026-09-03T10:27:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 89.911098] postgres[1576]: [1576] ERROR: relation "table_without_models" does not exist gitlab # [ 89.911410] postgres[1576]: [1576] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 99.296763] gitlab-workhorse[817]: time="2026-09-03T10:27:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 109.306670] gitlab-workhorse[817]: time="2026-09-03T10:28:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 119.103996] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 119.109379] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 119.115043] systemd[1]: Starting gitlab.service... gitlab # [ 119.313360] gitlab-workhorse[817]: time="2026-09-03T10:28:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 119.660493] bundle[1938]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 119.666525] bundle[1938]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 119.672451] bundle[1938]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 124.317990] bundle[1938]: {"timestamp":"2026-09-03T10:28:19.154Z","pid":1938,"message":"* Enabling systemd notification integration"} gitlab # [ 124.318523] bundle[1938]: {"timestamp":"2026-09-03T10:28:19.188Z","pid":1938,"message":"Puma starting in cluster mode..."} gitlab # [ 124.318726] bundle[1938]: {"timestamp":"2026-09-03T10:28:19.188Z","pid":1938,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 124.318854] bundle[1938]: {"timestamp":"2026-09-03T10:28:19.188Z","pid":1938,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 124.318972] bundle[1938]: {"timestamp":"2026-09-03T10:28:19.188Z","pid":1938,"message":"* Min threads: 0"} gitlab # [ 124.319087] bundle[1938]: {"timestamp":"2026-09-03T10:28:19.188Z","pid":1938,"message":"* Max threads: 4"} gitlab # [ 124.319185] bundle[1938]: {"timestamp":"2026-09-03T10:28:19.188Z","pid":1938,"message":"* Environment: production"} gitlab # [ 124.319321] bundle[1938]: {"timestamp":"2026-09-03T10:28:19.188Z","pid":1938,"message":"* Master PID: 1938"} gitlab # [ 124.319446] bundle[1938]: {"timestamp":"2026-09-03T10:28:19.188Z","pid":1938,"message":"* Workers: 2"} gitlab # [ 124.319559] bundle[1938]: {"timestamp":"2026-09-03T10:28:19.188Z","pid":1938,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 124.319674] bundle[1938]: {"timestamp":"2026-09-03T10:28:19.188Z","pid":1938,"message":"* Preloading application"} gitlab # [ 124.377450] sidekiq-cluster[1937]: {"severity":"INFO","time":"2026-09-03T10:28:19.203Z","message":"Starting cluster with 1 processes"} gitlab # [ 129.316251] gitlab-workhorse[817]: time="2026-09-03T10:28:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 139.320627] gitlab-workhorse[817]: time="2026-09-03T10:28:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 149.326159] gitlab-workhorse[817]: time="2026-09-03T10:28:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 159.333389] gitlab-workhorse[817]: time="2026-09-03T10:28:54Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 162.169986] bundle[1938]: W, [2026-09-03T10:28:57.040205 #1938] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 166.961110] sidekiq-cluster[1986]: 2026-09-03T10:29:01.831Z pid=1986 tid=woa INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>1986, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>428081152} gitlab # [ 167.257423] sidekiq-cluster[1986]: W, [2026-09-03T10:29:02.128654 #1986] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 167.398935] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:02.270Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 169.342227] gitlab-workhorse[817]: time="2026-09-03T10:29:04Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 170.571327] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.441Z","message":"GitLab reliable fetch activated!"} gitlab # [ 170.571738] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.441Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 170.602955] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.474Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 170.609959] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.476Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 170.617008] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.479Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 170.623522] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.482Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 170.630892] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.485Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 170.637454] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.488Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 170.643285] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.490Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 170.648138] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.492Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 170.652664] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.494Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 170.657163] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.496Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 170.661794] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.498Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 170.665874] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.501Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 170.669432] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.503Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 170.673121] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.505Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 170.676534] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.507Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 170.679805] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.509Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 170.682925] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.512Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 170.685790] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.515Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 170.688807] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.517Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 170.691531] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.520Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 170.694601] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.523Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 170.697663] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.526Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 170.700239] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.529Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 170.702776] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.532Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 170.705417] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.537Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 170.707799] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.543Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 170.710160] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.549Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 170.712486] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.557Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 170.714747] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.564Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 170.717135] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.570Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 170.719237] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.576Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 170.721638] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.581Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 170.723673] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.586Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 170.725997] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.591Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 170.728140] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.594Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 170.730207] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.597Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 170.732281] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.602Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 170.734901] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.606Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 170.738055] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.609Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 170.741301] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.612Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 170.744563] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.616Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 170.748230] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.619Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 170.751474] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.622Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 170.755371] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.626Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 170.759734] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.631Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 170.763393] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.634Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 170.767214] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.637Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 170.770822] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.641Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 170.774185] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.644Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 170.777436] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.647Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 170.780544] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.651Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 170.783460] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.654Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 170.798937] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.670Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 170.802674] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.674Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 170.806012] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.677Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 170.809266] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.680Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 170.812448] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.683Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 170.815765] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.685Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 170.819163] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.688Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 170.822518] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.690Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 170.825478] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.692Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 170.828237] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.694Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 170.896640] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.768Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 170.903360] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.771Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 170.910317] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.773Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 170.917090] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.778Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 170.923416] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.780Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 170.929369] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.783Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 170.934943] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.785Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 170.940104] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.786Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 170.944617] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.789Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 170.948790] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.791Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 170.952698] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.794Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 170.956580] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.796Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 170.960210] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.799Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 170.963737] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.801Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 170.967126] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.803Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 170.970719] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.806Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 170.973792] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.808Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 170.976648] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.810Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 170.979639] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.812Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 170.982952] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.815Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 170.985911] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.817Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 170.988691] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.821Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 170.991587] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.823Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 170.994550] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.826Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 170.998511] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.828Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 171.001354] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.831Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 171.004166] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.833Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 171.006876] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.835Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 171.009734] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.837Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 171.012482] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.840Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 171.015309] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.842Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 171.018551] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.844Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 171.021168] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.847Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 171.024085] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.851Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 171.026890] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.853Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 171.029775] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.857Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 171.032517] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.873Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 171.035149] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.876Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 171.037810] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.880Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 171.040420] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.883Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 171.042937] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.887Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 171.045607] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.889Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 171.048239] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.899Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 171.050990] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.901Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 171.053576] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.904Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 171.056198] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.907Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 171.058686] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:05.914Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 179.348720] gitlab-workhorse[817]: time="2026-09-03T10:29:14Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 189.353172] gitlab-workhorse[817]: time="2026-09-03T10:29:24Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 199.362338] gitlab-workhorse[817]: time="2026-09-03T10:29:34Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 208.355988] postgres[2696]: [2696] ERROR: relation "table_without_models" does not exist gitlab # [ 208.356481] postgres[2696]: [2696] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 209.370233] gitlab-workhorse[817]: time="2026-09-03T10:29:44Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 210.378278] sidekiq-cluster[1986]: InitializerConnections Query: SET client_min_messages TO 'warning' gitlab # [ 210.378660] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 210.378783] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 210.378930] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 210.379046] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 210.379163] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 210.379303] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 210.379427] sidekiq-cluster[1986]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 210.442327] sidekiq-cluster[1986]: InitializerConnections Query: SET standard_conforming_strings = on gitlab # [ 210.446144] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 210.450534] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 210.454351] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 210.458406] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 210.462081] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 210.465738] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 210.470390] sidekiq-cluster[1986]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 210.474950] sidekiq-cluster[1986]: InitializerConnections Query: SET intervalstyle = iso_8601 gitlab # [ 210.478102] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 210.481837] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 210.484871] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 210.487887] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 210.490590] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 210.493244] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 210.496265] sidekiq-cluster[1986]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 210.499209] sidekiq-cluster[1986]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname gitlab # [ 210.502551] sidekiq-cluster[1986]: FROM pg_type as t gitlab # [ 210.503761] sidekiq-cluster[1986]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz') gitlab # [ 210.506826] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 210.509171] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 210.511097] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 210.513187] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 210.514956] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 210.516760] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 210.518954] sidekiq-cluster[1986]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 210.521269] sidekiq-cluster[1986]: InitializerConnections Query: SET SESSION timezone TO 'UTC' gitlab # [ 210.522825] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 210.524874] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 210.526489] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 210.528215] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 210.529712] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 210.531228] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 210.533190] sidekiq-cluster[1986]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 210.535143] sidekiq-cluster[1986]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'sidekiq_throttling_middleware' gitlab # [ 210.539042] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 210.540792] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 210.542224] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 210.543773] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 210.545214] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 210.546559] sidekiq-cluster[1986]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 210.548219] sidekiq-cluster[1986]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 211.596257] postgres[2725]: [2725] ERROR: relation "table_without_models" does not exist gitlab # [ 211.596585] postgres[2725]: [2725] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 213.381492] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:48.252Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 213.389647] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:48.260Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 213.396073] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:48.261Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 213.401430] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:48.261Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 213.407549] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:48.263Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 216.016703] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:50.887Z","message":"Cleaning working queues"} gitlab # [ 216.020931] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:50.892Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b90395dd4515242317ddc284","created_at":"2026-09-03T10:28:13.400Z","trace_propagation_headers":{"sentry-trace":"bd911339730a44948994c07584197f22-3c95c00adb7b4b59","baggage":"sentry-trace_id=bd911339730a44948994c07584197f22,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"940d3ce48c803dc2a76c11747444245c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-03T10:28:13.411Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b90395dd4515242317ddc284: start","job_status":"start","queue_duration_s":97.480056,"scheduling_latency_s":97.480109} gitlab # [ 216.360901] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:29:51.231Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"b90395dd4515242317ddc284","created_at":"2026-09-03T10:28:13.400Z","trace_propagation_headers":{"sentry-trace":"bd911339730a44948994c07584197f22-3c95c00adb7b4b59","baggage":"sentry-trace_id=bd911339730a44948994c07584197f22,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"940d3ce48c803dc2a76c11747444245c","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-03T10:28:13.411Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-b90395dd4515242317ddc284: done: 0.339236 sec","job_status":"done","queue_duration_s":97.480056,"scheduling_latency_s":97.480109,"redis_calls":29,"redis_duration_s":0.013261,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.00737,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003695,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002196,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.201572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1992584,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.339236,"completed_at":"2026-09-03T10:29:51.230Z","load_balancing_strategy":"primary","db_duration_s":0.097347,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 218.568829] bundle[1938]: {"timestamp":"2026-09-03T10:29:53.439Z","pid":1938,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 218.569147] bundle[1938]: {"timestamp":"2026-09-03T10:29:53.439Z","pid":1938,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 218.569358] bundle[1938]: {"timestamp":"2026-09-03T10:29:53.439Z","pid":1938,"message":"! #\u003cThread:0x0000fb4396689860 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 218.569485] bundle[1938]: {"timestamp":"2026-09-03T10:29:53.439Z","pid":1938,"message":"! #\u003cThread:0x0000fb4395fbb330 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 218.569604] bundle[1938]: {"timestamp":"2026-09-03T10:29:53.439Z","pid":1938,"message":"Use Ctrl-C to stop"} gitlab # [ 218.569700] bundle[1938]: {"timestamp":"2026-09-03T10:29:53.439Z","pid":1938,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 219.297150] bundle[1938]: {"timestamp":"2026-09-03T10:29:54.168Z","pid":1938,"message":"- Worker 0 (PID: 2844) booted in 0.69s, phase: 0"} gitlab # [ 219.300113] bundle[1938]: {"timestamp":"2026-09-03T10:29:54.169Z","pid":1938,"message":"- Worker 1 (PID: 2848) booted in 0.68s, phase: 0"} gitlab # [ 219.304705] systemd[1]: Started gitlab.service. gitlab # [ 219.306946] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 219.310966] systemd[1]: Starting setup-gitlab.service... gitlab # [ 219.349098] setup-gitlab-start[2881]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 223.025105] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:29:57 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 3640 gitlab # [ 223.028935] setup-gitlab-start[2881]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 223.033954] setup-gitlab-start[2881]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 223.051420] runuser[2911]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 223.550696] setup-gitlab-start[2912]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 223.557285] setup-gitlab-start[2912]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 223.563466] setup-gitlab-start[2912]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 224.364425] setup-gitlab-start[2912]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 224.364802] setup-gitlab-start[2912]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 224.367025] setup-gitlab-start[2912]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 230.617759] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:05.487Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d4a6801bc1198462aabbaeb7","created_at":"2026-09-03T10:30:05.378Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bea2f0f2b322e166c74b715432680b2e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.482Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d4a6801bc1198462aabbaeb7: start","job_status":"start","queue_duration_s":0.004489,"scheduling_latency_s":0.00455} gitlab # [ 230.909230] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:05.779Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"d4a6801bc1198462aabbaeb7","created_at":"2026-09-03T10:30:05.378Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bea2f0f2b322e166c74b715432680b2e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.482Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-d4a6801bc1198462aabbaeb7: done: 0.292328 sec","job_status":"done","queue_duration_s":0.004489,"scheduling_latency_s":0.00455,"redis_calls":19,"redis_duration_s":0.048186,"redis_read_bytes":21,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.006922,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.001326,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.036507,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003431,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0135617,"duration_s":0.292328,"completed_at":"2026-09-03T10:30:05.779Z","load_balancing_strategy":"primary","db_duration_s":0.062942,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 231.004348] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:05.790Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9764b7fa2e1046a7417480b2","created_at":"2026-09-03T10:30:05.527Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"122a344a5c821edfecc14dab927e80bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.541Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9764b7fa2e1046a7417480b2: start","job_status":"start","queue_duration_s":0.248573,"scheduling_latency_s":0.24862} gitlab # [ 231.038534] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:05.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9764b7fa2e1046a7417480b2","created_at":"2026-09-03T10:30:05.527Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"122a344a5c821edfecc14dab927e80bb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.541Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9764b7fa2e1046a7417480b2: done: 0.119021 sec","job_status":"done","queue_duration_s":0.248573,"scheduling_latency_s":0.24862,"redis_calls":12,"redis_duration_s":0.020233,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.007928,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006057,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00324368,"duration_s":0.119021,"completed_at":"2026-09-03T10:30:05.908Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01684,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 231.103686] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:05.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"47a855f232d1208e0c45302e","created_at":"2026-09-03T10:30:05.573Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70fd42ff8d9e3590b061065eb7a7b202","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.590Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-47a855f232d1208e0c45302e: start","job_status":"start","queue_duration_s":0.325878,"scheduling_latency_s":0.325927} gitlab # [ 231.119508] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:05.979Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 231.149745] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:06.020Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"47a855f232d1208e0c45302e","created_at":"2026-09-03T10:30:05.573Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"70fd42ff8d9e3590b061065eb7a7b202","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.590Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-47a855f232d1208e0c45302e: done: 0.10343 sec","job_status":"done","queue_duration_s":0.325878,"scheduling_latency_s":0.325927,"redis_calls":10,"redis_duration_s":0.01733,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002438,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01267,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002222,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0014989,"duration_s":0.10343,"completed_at":"2026-09-03T10:30:06.020Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001547,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 231.249522] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:06.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"33a0ab7cdbead08af26885d7","created_at":"2026-09-03T10:30:05.617Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ecf479b7cf49ddf6f13b1368ff509a40","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.631Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-33a0ab7cdbead08af26885d7: start","job_status":"start","queue_duration_s":0.397612,"scheduling_latency_s":0.39766} gitlab # [ 231.359303] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:06.227Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"33a0ab7cdbead08af26885d7","created_at":"2026-09-03T10:30:05.617Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ecf479b7cf49ddf6f13b1368ff509a40","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.631Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-33a0ab7cdbead08af26885d7: done: 0.197789 sec","job_status":"done","queue_duration_s":0.397612,"scheduling_latency_s":0.39766,"redis_calls":24,"redis_duration_s":0.057248,"redis_read_bytes":25,"redis_write_bytes":5977,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.008493,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":704,"redis_queues_calls":2,"redis_queues_duration_s":0.009439,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3810,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.021003,"redis_queues_metadata_read_bytes":14,"redis_queues_metadata_write_bytes":894,"redis_shared_state_calls":7,"redis_shared_state_duration_s":0.018313,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":569,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.074668,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00091604,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.max_buckets":5,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.available_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.occupied_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.stale_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.missing_count":5,"duration_s":0.197789,"completed_at":"2026-09-03T10:30:06.226Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015993,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 231.454919] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:06.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"51a2fd559309efdf753ae928","created_at":"2026-09-03T10:30:05.643Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb13d44ae2a84fa986fa78991e978238","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.666Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-51a2fd559309efdf753ae928: start","job_status":"start","queue_duration_s":0.57312,"scheduling_latency_s":0.57317} gitlab # [ 231.577638] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:06.447Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"51a2fd559309efdf753ae928","created_at":"2026-09-03T10:30:05.643Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eb13d44ae2a84fa986fa78991e978238","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.666Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-51a2fd559309efdf753ae928: done: 0.208061 sec","job_status":"done","queue_duration_s":0.57312,"scheduling_latency_s":0.57317,"redis_calls":10,"redis_duration_s":0.042197,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.019946,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009907,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.012344,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00243912,"duration_s":0.208061,"completed_at":"2026-09-03T10:30:06.447Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019103,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 231.678584] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:06.457Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"14c0b0c62607a92faac56255","created_at":"2026-09-03T10:30:05.690Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37b07592b9fac136a5c7b918c219fe04","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.726Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-14c0b0c62607a92faac56255: start","job_status":"start","queue_duration_s":0.731091,"scheduling_latency_s":0.731141} gitlab # [ 231.697313] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:06.500Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 231.701072] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:06.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"14c0b0c62607a92faac56255","created_at":"2026-09-03T10:30:05.690Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37b07592b9fac136a5c7b918c219fe04","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.726Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-14c0b0c62607a92faac56255: done: 0.079386 sec","job_status":"done","queue_duration_s":0.731091,"scheduling_latency_s":0.731141,"redis_calls":10,"redis_duration_s":0.014323,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002011,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009462,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00285,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00416248,"duration_s":0.079386,"completed_at":"2026-09-03T10:30:06.536Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 231.743980] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:06.548Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"06ed3716588c75e6b9c38a82","created_at":"2026-09-03T10:30:05.670Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-192c22da60da477c","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bea2f0f2b322e166c74b715432680b2e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.731Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-06ed3716588c75e6b9c38a82: start","job_status":"start","queue_duration_s":0.817,"scheduling_latency_s":0.81705} gitlab # [ 231.896495] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:06.767Z","message":"No existing merge request to be cleaned up."} gitlab # [ 231.968888] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:06.839Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"06ed3716588c75e6b9c38a82","created_at":"2026-09-03T10:30:05.670Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-192c22da60da477c","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bea2f0f2b322e166c74b715432680b2e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.731Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-06ed3716588c75e6b9c38a82: done: 0.290721 sec","job_status":"done","queue_duration_s":0.817,"scheduling_latency_s":0.81705,"redis_calls":13,"redis_duration_s":0.033423,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002194,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.020183,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.011046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.088377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00173532,"duration_s":0.290721,"completed_at":"2026-09-03T10:30:06.839Z","load_balancing_strategy":"primary","db_duration_s":0.026309,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 232.054069] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:06.869Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"27aa52e281969d4e337eacd9","created_at":"2026-09-03T10:30:05.670Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-192c22da60da477c","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bea2f0f2b322e166c74b715432680b2e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.731Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-27aa52e281969d4e337eacd9: start","job_status":"start","queue_duration_s":1.137746,"scheduling_latency_s":1.137795} gitlab # [ 232.086720] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:06.957Z","message":"No existing merge request to be cleaned up."} gitlab # [ 232.135614] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.005Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"27aa52e281969d4e337eacd9","created_at":"2026-09-03T10:30:05.670Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-192c22da60da477c","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bea2f0f2b322e166c74b715432680b2e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.731Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-27aa52e281969d4e337eacd9: done: 0.136667 sec","job_status":"done","queue_duration_s":1.137746,"scheduling_latency_s":1.137795,"redis_calls":10,"redis_duration_s":0.014596999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006415,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.008182,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.061,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.061,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.136667,"completed_at":"2026-09-03T10:30:07.005Z","load_balancing_strategy":"primary","db_duration_s":0.061969,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 232.214350] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.018Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a1608a0af22237acbc4ef011","created_at":"2026-09-03T10:30:05.670Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-192c22da60da477c","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bea2f0f2b322e166c74b715432680b2e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.731Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a1608a0af22237acbc4ef011: start","job_status":"start","queue_duration_s":1.28645,"scheduling_latency_s":1.286495} gitlab # [ 232.230451] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.097Z","message":"No existing merge request to be cleaned up."} gitlab # [ 232.264812] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.135Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a1608a0af22237acbc4ef011","created_at":"2026-09-03T10:30:05.670Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-192c22da60da477c","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bea2f0f2b322e166c74b715432680b2e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.731Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a1608a0af22237acbc4ef011: done: 0.117396 sec","job_status":"done","queue_duration_s":1.28645,"scheduling_latency_s":1.286495,"redis_calls":10,"redis_duration_s":0.037336999999999995,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.023485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.013852,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.117396,"completed_at":"2026-09-03T10:30:07.135Z","load_balancing_strategy":"primary","db_duration_s":0.022213,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 232.329042] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.156Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"addd72e24b3eb475f7589155","created_at":"2026-09-03T10:30:05.670Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-192c22da60da477c","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bea2f0f2b322e166c74b715432680b2e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.731Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-addd72e24b3eb475f7589155: start","job_status":"start","queue_duration_s":1.425345,"scheduling_latency_s":1.425392} gitlab # [ 232.356564] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.228Z","message":"No existing merge request to be cleaned up."} gitlab # [ 232.376777] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.247Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"addd72e24b3eb475f7589155","created_at":"2026-09-03T10:30:05.670Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-192c22da60da477c","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"bea2f0f2b322e166c74b715432680b2e","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.731Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-addd72e24b3eb475f7589155: done: 0.090442 sec","job_status":"done","queue_duration_s":1.425345,"scheduling_latency_s":1.425392,"redis_calls":10,"redis_duration_s":0.009492,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002416,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.007076,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090442,"completed_at":"2026-09-03T10:30:07.247Z","load_balancing_strategy":"primary","db_duration_s":0.007665,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 232.424657] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bb48b373c34259367dd322d5","created_at":"2026-09-03T10:30:05.755Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cb4fa1de88dc1393077d60daaa8312d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:30:05.783Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bb48b373c34259367dd322d5: start","job_status":"start","queue_duration_s":1.467717,"scheduling_latency_s":1.467767} gitlab # [ 232.439242] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.277Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 232.443049] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.292Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bb48b373c34259367dd322d5","created_at":"2026-09-03T10:30:05.755Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cb4fa1de88dc1393077d60daaa8312d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:30:05.783Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bb48b373c34259367dd322d5: done: 0.042023 sec","job_status":"done","queue_duration_s":1.467717,"scheduling_latency_s":1.467767,"redis_calls":10,"redis_duration_s":0.003868,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000732,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002361,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00061532,"duration_s":0.042023,"completed_at":"2026-09-03T10:30:07.292Z","load_balancing_strategy":"primary","db_duration_s":0.000893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 232.484214] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.295Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"b3a0ba6a76636f3c137ec528","created_at":"2026-09-03T10:30:05.804Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ebdfc88d74c2ad0db73e5ffe31145775","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.851Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-b3a0ba6a76636f3c137ec528: start","job_status":"start","queue_duration_s":1.443634,"scheduling_latency_s":1.443662} gitlab # [ 232.519292] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.389Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"b3a0ba6a76636f3c137ec528","created_at":"2026-09-03T10:30:05.804Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ebdfc88d74c2ad0db73e5ffe31145775","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.851Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-b3a0ba6a76636f3c137ec528: done: 0.094519 sec","job_status":"done","queue_duration_s":1.443634,"scheduling_latency_s":1.443662,"redis_calls":10,"redis_duration_s":0.003646,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000597,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047174,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00082352,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.0059458},"duration_s":0.094519,"completed_at":"2026-09-03T10:30:07.389Z","load_balancing_strategy":"primary","db_duration_s":0.033894,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 232.564289] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.392Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bb60641fff1f7a9ec2c7e901","created_at":"2026-09-03T10:30:05.870Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a26e1daaf457d78c6bb4a0de5e1ad349","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.904Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bb60641fff1f7a9ec2c7e901: start","job_status":"start","queue_duration_s":1.488316,"scheduling_latency_s":1.488348} gitlab # [ 232.578617] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.413Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 232.582034] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.424Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"bb60641fff1f7a9ec2c7e901","created_at":"2026-09-03T10:30:05.870Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a26e1daaf457d78c6bb4a0de5e1ad349","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.904Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-bb60641fff1f7a9ec2c7e901: done: 0.032312 sec","job_status":"done","queue_duration_s":1.488316,"scheduling_latency_s":1.488348,"redis_calls":10,"redis_duration_s":0.0030499999999999998,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000758,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001704,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000588,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045672,"duration_s":0.032312,"completed_at":"2026-09-03T10:30:07.424Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000749,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 232.623830] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.427Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f9eac28b3080a9eb72d73b6c","created_at":"2026-09-03T10:30:05.930Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bad3feda7f2a650a4330fd89472f7102","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.961Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f9eac28b3080a9eb72d73b6c: start","job_status":"start","queue_duration_s":1.465855,"scheduling_latency_s":1.465881} gitlab # [ 232.984550] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f9eac28b3080a9eb72d73b6c","created_at":"2026-09-03T10:30:05.930Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bad3feda7f2a650a4330fd89472f7102","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:05.961Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f9eac28b3080a9eb72d73b6c: done: 0.427208 sec","job_status":"done","queue_duration_s":1.465855,"scheduling_latency_s":1.465881,"redis_calls":565,"redis_duration_s":0.10727600000000001,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000582,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001699,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.104995,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.363782,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051056,"duration_s":0.427208,"completed_at":"2026-09-03T10:30:07.854Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000675,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.061269] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.856Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"1945a73c19052343db2e4521","created_at":"2026-09-03T10:30:05.995Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5cd26ae1bd2b6fda585b95cda280edc4","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.016Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-1945a73c19052343db2e4521: start","job_status":"start","queue_duration_s":1.839701,"scheduling_latency_s":1.839719} gitlab # [ 233.081159] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"1945a73c19052343db2e4521","created_at":"2026-09-03T10:30:05.995Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5cd26ae1bd2b6fda585b95cda280edc4","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.016Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-1945a73c19052343db2e4521: done: 0.030746 sec","job_status":"done","queue_duration_s":1.839701,"scheduling_latency_s":1.839719,"redis_calls":13,"redis_duration_s":0.003451,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000526,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001609,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001316,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032868,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.030746,"completed_at":"2026-09-03T10:30:07.887Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00555,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.129079] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.888Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"bac9954537d749275e00c9be","created_at":"2026-09-03T10:30:06.030Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4e09f59a0fb40ef7bb597f92d2f3a93","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.041Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-bac9954537d749275e00c9be: start","job_status":"start","queue_duration_s":1.847503,"scheduling_latency_s":1.847522} gitlab # [ 233.142081] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.911Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"bac9954537d749275e00c9be","created_at":"2026-09-03T10:30:06.030Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4e09f59a0fb40ef7bb597f92d2f3a93","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.041Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-bac9954537d749275e00c9be: done: 0.022714 sec","job_status":"done","queue_duration_s":1.847503,"scheduling_latency_s":1.847522,"redis_calls":12,"redis_duration_s":0.00307,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.00058,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000516,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001477,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000497,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032346,"duration_s":0.022714,"completed_at":"2026-09-03T10:30:07.911Z","load_balancing_strategy":"primary","db_duration_s":0.000732,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.183487] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"29c36f892e7a24204d8c2d31","created_at":"2026-09-03T10:30:06.072Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c96137dfa317d29a27bc4b1e3db5a69a","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.083Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-29c36f892e7a24204d8c2d31: start","job_status":"start","queue_duration_s":1.829667,"scheduling_latency_s":1.829685} gitlab # [ 233.196515] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.937Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"29c36f892e7a24204d8c2d31","created_at":"2026-09-03T10:30:06.072Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c96137dfa317d29a27bc4b1e3db5a69a","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.083Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-29c36f892e7a24204d8c2d31: done: 0.024566 sec","job_status":"done","queue_duration_s":1.829667,"scheduling_latency_s":1.829685,"redis_calls":10,"redis_duration_s":0.002495,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000517,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001435,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003318,"duration_s":0.024566,"completed_at":"2026-09-03T10:30:07.937Z","load_balancing_strategy":"primary","db_duration_s":0.000617,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.236543] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:07.939Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"5ff8d47af7ddfb5b0a9e7b9b","created_at":"2026-09-03T10:30:06.105Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13fdf24125eaf53cc2f402db8bb4a125","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.150Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-5ff8d47af7ddfb5b0a9e7b9b: start","job_status":"start","queue_duration_s":1.789043,"scheduling_latency_s":1.789059} gitlab # [ 233.251923] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.019Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"5ff8d47af7ddfb5b0a9e7b9b","created_at":"2026-09-03T10:30:06.105Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13fdf24125eaf53cc2f402db8bb4a125","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.150Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-5ff8d47af7ddfb5b0a9e7b9b: done: 0.08039 sec","job_status":"done","queue_duration_s":1.789043,"scheduling_latency_s":1.789059,"redis_calls":12,"redis_duration_s":0.003491,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000544,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001563,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001384,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008348,"exclusive_lock_hold_duration_s":0.03968238,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.08039,"completed_at":"2026-09-03T10:30:08.019Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.295851] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"2e8afbb38aa4199715584bb1","created_at":"2026-09-03T10:30:06.107Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cac4862787444157","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"ecf479b7cf49ddf6f13b1368ff509a40","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.181Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-2e8afbb38aa4199715584bb1: start","job_status":"start","queue_duration_s":1.840018,"scheduling_latency_s":1.840036} gitlab # [ 233.308240] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"2e8afbb38aa4199715584bb1","created_at":"2026-09-03T10:30:06.107Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cac4862787444157","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"ecf479b7cf49ddf6f13b1368ff509a40","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.181Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-2e8afbb38aa4199715584bb1: done: 0.051984 sec","job_status":"done","queue_duration_s":1.840018,"scheduling_latency_s":1.840036,"redis_calls":18,"redis_duration_s":0.005312,"redis_read_bytes":39,"redis_write_bytes":2116,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000511,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001335,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":471,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.003466,"redis_shared_state_read_bytes":34,"redis_shared_state_write_bytes":1324,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036104,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":4,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":4,"duration_s":0.051984,"completed_at":"2026-09-03T10:30:08.073Z","load_balancing_strategy":"primary","db_duration_s":0.01594,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.350923] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.075Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"93e5b1efffa66c2e776a8319","created_at":"2026-09-03T10:30:06.107Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cac4862787444157","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"ecf479b7cf49ddf6f13b1368ff509a40","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.181Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-93e5b1efffa66c2e776a8319: start","job_status":"start","queue_duration_s":1.894009,"scheduling_latency_s":1.894029} gitlab # [ 233.363405] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"93e5b1efffa66c2e776a8319","created_at":"2026-09-03T10:30:06.107Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cac4862787444157","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"ecf479b7cf49ddf6f13b1368ff509a40","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.181Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-93e5b1efffa66c2e776a8319: done: 0.028175 sec","job_status":"done","queue_duration_s":1.894009,"scheduling_latency_s":1.894029,"redis_calls":15,"redis_duration_s":0.0034609999999999997,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.002349,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":4,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":4,"duration_s":0.028175,"completed_at":"2026-09-03T10:30:08.103Z","load_balancing_strategy":"primary","db_duration_s":0.004441,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.406066] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"7ef54841881c0a4c3fa307d8","created_at":"2026-09-03T10:30:06.107Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cac4862787444157","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"ecf479b7cf49ddf6f13b1368ff509a40","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.181Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-7ef54841881c0a4c3fa307d8: start","job_status":"start","queue_duration_s":1.923829,"scheduling_latency_s":1.923847} gitlab # [ 233.418467] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"7ef54841881c0a4c3fa307d8","created_at":"2026-09-03T10:30:06.107Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cac4862787444157","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"ecf479b7cf49ddf6f13b1368ff509a40","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.181Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-7ef54841881c0a4c3fa307d8: done: 0.026418 sec","job_status":"done","queue_duration_s":1.923829,"scheduling_latency_s":1.923847,"redis_calls":15,"redis_duration_s":0.003661,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001354,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.002307,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015985,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":4,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":4,"duration_s":0.026418,"completed_at":"2026-09-03T10:30:08.131Z","load_balancing_strategy":"primary","db_duration_s":0.004269,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.461848] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"44066496da56e6b25dbb02fb","created_at":"2026-09-03T10:30:06.107Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cac4862787444157","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"ecf479b7cf49ddf6f13b1368ff509a40","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.181Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-44066496da56e6b25dbb02fb: start","job_status":"start","queue_duration_s":1.951741,"scheduling_latency_s":1.951757} gitlab # [ 233.474144] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"44066496da56e6b25dbb02fb","created_at":"2026-09-03T10:30:06.107Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cac4862787444157","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"ecf479b7cf49ddf6f13b1368ff509a40","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.181Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-44066496da56e6b25dbb02fb: done: 0.028802 sec","job_status":"done","queue_duration_s":1.951741,"scheduling_latency_s":1.951757,"redis_calls":15,"redis_duration_s":0.003595,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001121,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.002474,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":4,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":4,"duration_s":0.028802,"completed_at":"2026-09-03T10:30:08.162Z","load_balancing_strategy":"primary","db_duration_s":0.004424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.515497] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"61a227705e95d2117e0f3e4a","created_at":"2026-09-03T10:30:06.107Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cac4862787444157","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"ecf479b7cf49ddf6f13b1368ff509a40","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.181Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-61a227705e95d2117e0f3e4a: start","job_status":"start","queue_duration_s":1.982436,"scheduling_latency_s":1.982454} gitlab # [ 233.528739] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.190Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::BulkDeleteExpiredJobArtifactsWorker","args":[],"jid":"61a227705e95d2117e0f3e4a","created_at":"2026-09-03T10:30:06.107Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cac4862787444157","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","correlation_id":"ecf479b7cf49ddf6f13b1368ff509a40","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.181Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::BulkDeleteExpiredJobArtifactsWorker JID-61a227705e95d2117e0f3e4a: done: 0.02682 sec","job_status":"done","queue_duration_s":1.982436,"scheduling_latency_s":1.982454,"redis_calls":15,"redis_duration_s":0.003561,"redis_read_bytes":35,"redis_write_bytes":1707,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":383,"redis_shared_state_calls":11,"redis_shared_state_duration_s":0.002456,"redis_shared_state_read_bytes":32,"redis_shared_state_write_bytes":1324,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016588,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.artifacts_empty":true,"extra.ci_bulk_delete_expired_job_artifacts_worker.destroyed_job_artifacts_count":0,"extra.ci_bulk_delete_expired_job_artifacts_worker.mod_bucket_released":0,"duration_s":0.02682,"completed_at":"2026-09-03T10:30:08.190Z","load_balancing_strategy":"primary","db_duration_s":0.004613,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.570379] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.192Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"89dd5abf33cd1294e36f2c6b","created_at":"2026-09-03T10:30:06.167Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8633d383b5a0967cf805989dfde09659","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.185Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-89dd5abf33cd1294e36f2c6b: start","job_status":"start","queue_duration_s":2.006843,"scheduling_latency_s":2.006861} gitlab # [ 233.584014] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.221Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"89dd5abf33cd1294e36f2c6b","created_at":"2026-09-03T10:30:06.167Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8633d383b5a0967cf805989dfde09659","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.185Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-89dd5abf33cd1294e36f2c6b: done: 0.029133 sec","job_status":"done","queue_duration_s":2.006843,"scheduling_latency_s":2.006861,"redis_calls":12,"redis_duration_s":0.003253,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000519,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001527,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001207,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058952,"exclusive_lock_hold_duration_s":0.00861926,"duration_s":0.029133,"completed_at":"2026-09-03T10:30:08.221Z","load_balancing_strategy":"primary","db_duration_s":0.004948,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.624823] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"27e77b4986514e92ff437f77","created_at":"2026-09-03T10:30:06.191Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0908e1423a4fd26f6a32f3790059fb7c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.216Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-27e77b4986514e92ff437f77: start","job_status":"start","queue_duration_s":2.006885,"scheduling_latency_s":2.006901} gitlab # [ 233.639175] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.250Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"27e77b4986514e92ff437f77","created_at":"2026-09-03T10:30:06.191Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0908e1423a4fd26f6a32f3790059fb7c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.216Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-27e77b4986514e92ff437f77: done: 0.027542 sec","job_status":"done","queue_duration_s":2.006885,"scheduling_latency_s":2.006901,"redis_calls":12,"redis_duration_s":0.003255,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000578,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001442,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001235,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062466,"exclusive_lock_hold_duration_s":0.006514600000000001,"duration_s":0.027542,"completed_at":"2026-09-03T10:30:08.250Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.682246] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"1d8196563fba7ef54d3b886e","created_at":"2026-09-03T10:30:06.229Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e41a0649b322aec168ec8d9102534ac8","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.244Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-1d8196563fba7ef54d3b886e: start","job_status":"start","queue_duration_s":2.007538,"scheduling_latency_s":2.007554} gitlab # [ 233.696636] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.390Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"1d8196563fba7ef54d3b886e","created_at":"2026-09-03T10:30:06.229Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e41a0649b322aec168ec8d9102534ac8","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.244Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-1d8196563fba7ef54d3b886e: done: 0.138047 sec","job_status":"done","queue_duration_s":2.007538,"scheduling_latency_s":2.007554,"redis_calls":11,"redis_duration_s":0.002968,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000632,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001444,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.125197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033112,"duration_s":0.138047,"completed_at":"2026-09-03T10:30:08.390Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000793,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.738276] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.392Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"9a5b647d92db828563894c85","created_at":"2026-09-03T10:30:06.253Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39fc00e9dd474869f60b1443d6ecfaa0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.263Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-9a5b647d92db828563894c85: start","job_status":"start","queue_duration_s":2.128705,"scheduling_latency_s":2.128721} gitlab # [ 233.751089] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.425Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"9a5b647d92db828563894c85","created_at":"2026-09-03T10:30:06.253Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"39fc00e9dd474869f60b1443d6ecfaa0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.263Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-9a5b647d92db828563894c85: done: 0.033799 sec","job_status":"done","queue_duration_s":2.128705,"scheduling_latency_s":2.128721,"redis_calls":11,"redis_duration_s":0.007884,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000568,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006428,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.001003,"duration_s":0.033799,"completed_at":"2026-09-03T10:30:08.425Z","load_balancing_strategy":"primary","db_duration_s":0.005676,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.791788] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.427Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::ImportFileCleanupWorker","jid":"62e90655e3b89f3a28cebcb5","created_at":"2026-09-03T10:30:06.275Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b724287716617cce4999e72d920626c","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:872203d04eabf30611038084c617b8ff07fd3e5607b1d8e2c977d615a3cfd3cb","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.286Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::ImportFileCleanupWorker JID-62e90655e3b89f3a28cebcb5: start","job_status":"start","queue_duration_s":2.141528,"scheduling_latency_s":2.141544} gitlab # [ 233.806045] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.455Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::ImportFileCleanupWorker","jid":"62e90655e3b89f3a28cebcb5","created_at":"2026-09-03T10:30:06.275Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b724287716617cce4999e72d920626c","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:872203d04eabf30611038084c617b8ff07fd3e5607b1d8e2c977d615a3cfd3cb","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.286Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::ImportFileCleanupWorker JID-62e90655e3b89f3a28cebcb5: done: 0.028075 sec","job_status":"done","queue_duration_s":2.141528,"scheduling_latency_s":2.141544,"redis_calls":10,"redis_duration_s":0.00226,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000554,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001284,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000422,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002719,"duration_s":0.028075,"completed_at":"2026-09-03T10:30:08.455Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003536,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.847540] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.457Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"51a1d5f2ac33aba0f7b5b22c","created_at":"2026-09-03T10:30:06.291Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a192df08544195c38071c727a2345c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.300Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-51a1d5f2ac33aba0f7b5b22c: start","job_status":"start","queue_duration_s":2.157375,"scheduling_latency_s":2.157392} gitlab # [ 233.863077] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.468Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 233.866721] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.475Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"51a1d5f2ac33aba0f7b5b22c","created_at":"2026-09-03T10:30:06.291Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a192df08544195c38071c727a2345c3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.300Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-51a1d5f2ac33aba0f7b5b22c: done: 0.017916 sec","job_status":"done","queue_duration_s":2.157375,"scheduling_latency_s":2.157392,"redis_calls":10,"redis_duration_s":0.001965,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000418,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001154,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000393,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032052,"duration_s":0.017916,"completed_at":"2026-09-03T10:30:08.475Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.908424] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.476Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"beef8addbbe2cb701bdc0507","created_at":"2026-09-03T10:30:06.304Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28b68ebf32bae1cacfaf9c72dccf1090","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.312Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-beef8addbbe2cb701bdc0507: start","job_status":"start","queue_duration_s":2.164546,"scheduling_latency_s":2.164563} gitlab # [ 233.921453] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.510Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"beef8addbbe2cb701bdc0507","created_at":"2026-09-03T10:30:06.304Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"28b68ebf32bae1cacfaf9c72dccf1090","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.312Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-beef8addbbe2cb701bdc0507: done: 0.033297 sec","job_status":"done","queue_duration_s":2.164546,"scheduling_latency_s":2.164563,"redis_calls":10,"redis_duration_s":0.0025960000000000002,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000515,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00155,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000531,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038382,"duration_s":0.033297,"completed_at":"2026-09-03T10:30:08.510Z","load_balancing_strategy":"primary","db_duration_s":0.006272,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 233.962355] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.511Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckExportJobsWorker","jid":"c427b55426b583547bf5ed12","created_at":"2026-09-03T10:30:06.319Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a710a6fc2b8917a9ce2f2182e74179fc","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c05136a1912f23c3950f9f6243170d655fcc26d1e5b96896d7e248d72f9039fe","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.341Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckExportJobsWorker JID-c427b55426b583547bf5ed12: start","job_status":"start","queue_duration_s":2.170314,"scheduling_latency_s":2.170332} gitlab # [ 233.975281] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.538Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckExportJobsWorker","jid":"c427b55426b583547bf5ed12","created_at":"2026-09-03T10:30:06.319Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a710a6fc2b8917a9ce2f2182e74179fc","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c05136a1912f23c3950f9f6243170d655fcc26d1e5b96896d7e248d72f9039fe","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.341Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckExportJobsWorker JID-c427b55426b583547bf5ed12: done: 0.026315 sec","job_status":"done","queue_duration_s":2.170314,"scheduling_latency_s":2.170332,"redis_calls":10,"redis_duration_s":0.002374,"redis_read_bytes":9,"redis_write_bytes":995,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0006,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001349,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000425,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":192,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027994,"duration_s":0.026315,"completed_at":"2026-09-03T10:30:08.537Z","load_balancing_strategy":"primary","db_duration_s":0.004552,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.015987] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.539Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"45b38873ee5fe54dc8e1192d","created_at":"2026-09-03T10:30:06.379Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bdb02a8ff268315d3b1ef8084f72eef","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.398Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-45b38873ee5fe54dc8e1192d: start","job_status":"start","queue_duration_s":2.141237,"scheduling_latency_s":2.141254} gitlab # [ 234.029795] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.569Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"45b38873ee5fe54dc8e1192d","created_at":"2026-09-03T10:30:06.379Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bdb02a8ff268315d3b1ef8084f72eef","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.398Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-45b38873ee5fe54dc8e1192d: done: 0.030459 sec","job_status":"done","queue_duration_s":2.141237,"scheduling_latency_s":2.141254,"redis_calls":17,"redis_duration_s":0.002538,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001153,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000798,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000248,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000339,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026442,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.030459,"completed_at":"2026-09-03T10:30:08.569Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002281,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.074192] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.571Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Export::PruneProjectExportJobsWorker","jid":"7fdf123335aa34b7f5bddd92","created_at":"2026-09-03T10:30:06.429Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b18783afbe528b01b549d8b0b596cca","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b2f7045536fe38235224f4d98e515e25b0b0eea1aa1ae4b4ab9f99ab22c53b43","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.460Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Export::PruneProjectExportJobsWorker JID-7fdf123335aa34b7f5bddd92: start","job_status":"start","queue_duration_s":2.110625,"scheduling_latency_s":2.110642} gitlab # [ 234.088482] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.596Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Export::PruneProjectExportJobsWorker","jid":"7fdf123335aa34b7f5bddd92","created_at":"2026-09-03T10:30:06.429Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1b18783afbe528b01b549d8b0b596cca","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:b2f7045536fe38235224f4d98e515e25b0b0eea1aa1ae4b4ab9f99ab22c53b43","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.460Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Export::PruneProjectExportJobsWorker JID-7fdf123335aa34b7f5bddd92: done: 0.025525 sec","job_status":"done","queue_duration_s":2.110625,"scheduling_latency_s":2.110642,"redis_calls":10,"redis_duration_s":0.001384,"redis_read_bytes":9,"redis_write_bytes":1173,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000272,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000284,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":236,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025414,"duration_s":0.025525,"completed_at":"2026-09-03T10:30:08.596Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003281,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.129960] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.597Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"75c09618be9782ff4bc7f391","created_at":"2026-09-03T10:30:06.497Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3a7b2d6a62024fd8e05506dc4a1da11","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.531Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-75c09618be9782ff4bc7f391: start","job_status":"start","queue_duration_s":2.065986,"scheduling_latency_s":2.066004} gitlab # [ 234.143936] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.862Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"75c09618be9782ff4bc7f391","created_at":"2026-09-03T10:30:06.497Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3a7b2d6a62024fd8e05506dc4a1da11","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.531Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-75c09618be9782ff4bc7f391: done: 0.264805 sec","job_status":"done","queue_duration_s":2.065986,"scheduling_latency_s":2.066004,"redis_calls":14,"redis_duration_s":0.002202,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00064,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000757,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.198884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00052186,"exclusive_lock_hold_duration_s":0.24110136,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.264805,"completed_at":"2026-09-03T10:30:08.862Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.073554,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.187493] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.864Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"c39ac77cbbbc5320953bea91","created_at":"2026-09-03T10:30:06.550Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e4bd8d4c89895588f4f841b2ff7e024","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.563Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-c39ac77cbbbc5320953bea91: start","job_status":"start","queue_duration_s":2.300486,"scheduling_latency_s":2.300506} gitlab # [ 234.201640] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.886Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"c39ac77cbbbc5320953bea91","created_at":"2026-09-03T10:30:06.550Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e4bd8d4c89895588f4f841b2ff7e024","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.563Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-c39ac77cbbbc5320953bea91: done: 0.022394 sec","job_status":"done","queue_duration_s":2.300486,"scheduling_latency_s":2.300506,"redis_calls":10,"redis_duration_s":0.001404,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000293,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00032,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025502,"duration_s":0.022394,"completed_at":"2026-09-03T10:30:08.886Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001022,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.243270] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:08.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"fdeeb30237d9730209758aad","created_at":"2026-09-03T10:30:06.601Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.632Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-fdeeb30237d9730209758aad: start","job_status":"start","queue_duration_s":2.254984,"scheduling_latency_s":2.255001} gitlab # [ 234.256736] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.009Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"fdeeb30237d9730209758aad","created_at":"2026-09-03T10:30:06.601Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.632Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-fdeeb30237d9730209758aad: done: 0.121239 sec","job_status":"done","queue_duration_s":2.254984,"scheduling_latency_s":2.255001,"redis_calls":71,"redis_duration_s":0.018432999999999998,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002474,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001253,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013966,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00074,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.100979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062682,"duration_s":0.121239,"completed_at":"2026-09-03T10:30:09.008Z","load_balancing_strategy":"primary","db_duration_s":0.003212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.299646] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.010Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f67e8f0dcade608cd78e2a2e","created_at":"2026-09-03T10:30:06.689Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2fcb3df61b5d91f8e61a6b330e4474d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.699Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f67e8f0dcade608cd78e2a2e: start","job_status":"start","queue_duration_s":2.311423,"scheduling_latency_s":2.31144} gitlab # [ 234.314304] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.069Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"f67e8f0dcade608cd78e2a2e","created_at":"2026-09-03T10:30:06.689Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2fcb3df61b5d91f8e61a6b330e4474d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.699Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-f67e8f0dcade608cd78e2a2e: done: 0.059193 sec","job_status":"done","queue_duration_s":2.311423,"scheduling_latency_s":2.31144,"redis_calls":14,"redis_duration_s":0.003741,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001055,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001446,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00124,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006167,"exclusive_lock_hold_duration_s":0.0359426,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.059193,"completed_at":"2026-09-03T10:30:09.069Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026525,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.358504] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.071Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"981dcc72ae4af84e27b478ff","created_at":"2026-09-03T10:30:06.713Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d51e5d1cb237fea3a09054cfe303bf3","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.725Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-981dcc72ae4af84e27b478ff: start","job_status":"start","queue_duration_s":2.34588,"scheduling_latency_s":2.345896} gitlab # [ 234.372663] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.097Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"981dcc72ae4af84e27b478ff","created_at":"2026-09-03T10:30:06.713Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3d51e5d1cb237fea3a09054cfe303bf3","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.725Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-981dcc72ae4af84e27b478ff: done: 0.026219 sec","job_status":"done","queue_duration_s":2.34588,"scheduling_latency_s":2.345896,"redis_calls":10,"redis_duration_s":0.0028350000000000003,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000653,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00161,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000572,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037638,"duration_s":0.026219,"completed_at":"2026-09-03T10:30:09.097Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004171,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.414296] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.099Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c65a350266cbabeb6d7dba51","created_at":"2026-09-03T10:30:06.732Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab93a71cfcb55aff8576f8b19ac98d77","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:30:06.742Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c65a350266cbabeb6d7dba51: start","job_status":"start","queue_duration_s":2.356621,"scheduling_latency_s":2.356638} gitlab # [ 234.427716] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.111Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 234.431243] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.119Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c65a350266cbabeb6d7dba51","created_at":"2026-09-03T10:30:06.732Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab93a71cfcb55aff8576f8b19ac98d77","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:30:06.742Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c65a350266cbabeb6d7dba51: done: 0.020019 sec","job_status":"done","queue_duration_s":2.356621,"scheduling_latency_s":2.356638,"redis_calls":10,"redis_duration_s":0.00251,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000561,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001462,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000487,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033368,"duration_s":0.020019,"completed_at":"2026-09-03T10:30:09.118Z","load_balancing_strategy":"primary","db_duration_s":0.000682,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.473480] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.120Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"5abeeb33039bb8e0868107b0","created_at":"2026-09-03T10:30:06.748Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9648621e19ae37a742d3003163a7ec6c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.765Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-5abeeb33039bb8e0868107b0: start","job_status":"start","queue_duration_s":2.355258,"scheduling_latency_s":2.355274} gitlab # [ 234.487857] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.154Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"5abeeb33039bb8e0868107b0","created_at":"2026-09-03T10:30:06.748Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9648621e19ae37a742d3003163a7ec6c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.765Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-5abeeb33039bb8e0868107b0: done: 0.033581 sec","job_status":"done","queue_duration_s":2.355258,"scheduling_latency_s":2.355274,"redis_calls":20,"redis_duration_s":0.0046619999999999995,"redis_read_bytes":23,"redis_write_bytes":4313,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001485,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000774,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2018,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001914,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000489,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032942,"duration_s":0.033581,"completed_at":"2026-09-03T10:30:09.154Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.532207] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.155Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"9b414ed4dce399814fcbc153","created_at":"2026-09-03T10:30:06.778Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"409db6f00a11089610f3e777ece0037b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.798Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-9b414ed4dce399814fcbc153: start","job_status":"start","queue_duration_s":2.356804,"scheduling_latency_s":2.35682} gitlab # [ 234.545344] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.179Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"9b414ed4dce399814fcbc153","created_at":"2026-09-03T10:30:06.778Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"409db6f00a11089610f3e777ece0037b","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.798Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-9b414ed4dce399814fcbc153: done: 0.023689 sec","job_status":"done","queue_duration_s":2.356804,"scheduling_latency_s":2.35682,"redis_calls":10,"redis_duration_s":0.002486,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000541,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001459,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000486,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003478,"duration_s":0.023689,"completed_at":"2026-09-03T10:30:09.179Z","load_balancing_strategy":"primary","db_duration_s":0.000528,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.586322] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.180Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"bb94c071bbe365c7fcd298a7","created_at":"2026-09-03T10:30:06.825Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34d2aaab0c8a97e8281dbf3707964108","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.842Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-bb94c071bbe365c7fcd298a7: start","job_status":"start","queue_duration_s":2.338392,"scheduling_latency_s":2.338409} gitlab # [ 234.600408] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.208Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"bb94c071bbe365c7fcd298a7","created_at":"2026-09-03T10:30:06.825Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"34d2aaab0c8a97e8281dbf3707964108","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.842Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-bb94c071bbe365c7fcd298a7: done: 0.027867 sec","job_status":"done","queue_duration_s":2.338392,"scheduling_latency_s":2.338409,"redis_calls":10,"redis_duration_s":0.002873,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000494,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001887,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036356,"duration_s":0.027867,"completed_at":"2026-09-03T10:30:09.208Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006365,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.641799] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.210Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"099251d90d68e632e430b699","created_at":"2026-09-03T10:30:06.860Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09f70a1d2c890b3346375441fc150347","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.904Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-099251d90d68e632e430b699: start","job_status":"start","queue_duration_s":2.30605,"scheduling_latency_s":2.306065} gitlab # [ 234.655730] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.259Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"099251d90d68e632e430b699","created_at":"2026-09-03T10:30:06.860Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"09f70a1d2c890b3346375441fc150347","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.904Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-099251d90d68e632e430b699: done: 0.048942 sec","job_status":"done","queue_duration_s":2.30605,"scheduling_latency_s":2.306065,"redis_calls":10,"redis_duration_s":0.002774,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00056,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001676,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000538,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046636,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.048942,"completed_at":"2026-09-03T10:30:09.259Z","load_balancing_strategy":"primary","db_duration_s":0.023929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.699067] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.261Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8583b7ca26515b3fe0e772f0","created_at":"2026-09-03T10:30:06.958Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f963d9e829fc4fb16a0e4c7d5815572","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.991Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8583b7ca26515b3fe0e772f0: start","job_status":"start","queue_duration_s":2.269303,"scheduling_latency_s":2.269321} gitlab # [ 234.713414] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.296Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"8583b7ca26515b3fe0e772f0","created_at":"2026-09-03T10:30:06.958Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f963d9e829fc4fb16a0e4c7d5815572","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:06.991Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-8583b7ca26515b3fe0e772f0: done: 0.035287 sec","job_status":"done","queue_duration_s":2.269303,"scheduling_latency_s":2.269321,"redis_calls":13,"redis_duration_s":0.003921,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000657,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001818,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001446,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.011385860000000001,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.035287,"completed_at":"2026-09-03T10:30:09.296Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004581,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 234.757731] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.297Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"a053feb9360b2109825672a7","created_at":"2026-09-03T10:30:07.008Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8aa450ffad729c3f1b50659966ade10","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:07.024Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-a053feb9360b2109825672a7: start","job_status":"start","queue_duration_s":2.272961,"scheduling_latency_s":2.272978} gitlab # [ 234.770797] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.320Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"a053feb9360b2109825672a7","created_at":"2026-09-03T10:30:07.008Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8aa450ffad729c3f1b50659966ade10","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:07.024Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-a053feb9360b2109825672a7: done: 0.023095 sec","job_status":"done","queue_duration_s":2.272961,"scheduling_latency_s":2.272978,"redis_calls":10,"redis_duration_s":0.00382,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000567,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001542,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001711,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012679,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033616,"duration_s":0.023095,"completed_at":"2026-09-03T10:30:09.320Z","load_balancing_strategy":"primary","db_duration_s":0.001526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.811301] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.322Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"98dc08162cbddff9da7fdfc0","created_at":"2026-09-03T10:30:07.064Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7363811e3978cbe045800fb4a5090ac","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:07.087Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-98dc08162cbddff9da7fdfc0: start","job_status":"start","queue_duration_s":2.235166,"scheduling_latency_s":2.235184} gitlab # [ 234.824677] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.360Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"98dc08162cbddff9da7fdfc0","created_at":"2026-09-03T10:30:07.064Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f7363811e3978cbe045800fb4a5090ac","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:07.087Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-98dc08162cbddff9da7fdfc0: done: 0.038545 sec","job_status":"done","queue_duration_s":2.235166,"scheduling_latency_s":2.235184,"redis_calls":10,"redis_duration_s":0.002027,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000312,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000772,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003226,"duration_s":0.038545,"completed_at":"2026-09-03T10:30:09.360Z","load_balancing_strategy":"primary","db_duration_s":0.012973,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.864926] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"77fac6104804e447271be03e","created_at":"2026-09-03T10:30:07.110Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4fe7f8d9315408ad5d701af12c8e96d7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:30:07.129Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-77fac6104804e447271be03e: start","job_status":"start","queue_duration_s":2.233019,"scheduling_latency_s":2.233039} gitlab # [ 234.878727] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.398Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"77fac6104804e447271be03e","created_at":"2026-09-03T10:30:07.110Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4fe7f8d9315408ad5d701af12c8e96d7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:30:07.129Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-77fac6104804e447271be03e: done: 0.035643 sec","job_status":"done","queue_duration_s":2.233019,"scheduling_latency_s":2.233039,"redis_calls":10,"redis_duration_s":0.001531,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000342,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000887,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002587,"duration_s":0.035643,"completed_at":"2026-09-03T10:30:09.398Z","load_balancing_strategy":"primary","db_duration_s":0.005569,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.918672] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.399Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b24c174a21f64431a4455904","created_at":"2026-09-03T10:30:07.150Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7b4d70d23435fbc1de96c063f298457","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:07.167Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b24c174a21f64431a4455904: start","job_status":"start","queue_duration_s":2.231905,"scheduling_latency_s":2.231922} gitlab # [ 234.932589] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.426Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b24c174a21f64431a4455904","created_at":"2026-09-03T10:30:07.150Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a7b4d70d23435fbc1de96c063f298457","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:07.167Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b24c174a21f64431a4455904: done: 0.026615 sec","job_status":"done","queue_duration_s":2.231905,"scheduling_latency_s":2.231922,"redis_calls":12,"redis_duration_s":0.001773,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000313,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000682,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0004942,"exclusive_lock_hold_duration_s":0.00410592,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.026615,"completed_at":"2026-09-03T10:30:09.426Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002193,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.974751] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.427Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"837add07ec4e08aae797e043","created_at":"2026-09-03T10:30:07.210Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"627cec328af9bb144b0c829d75564613","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:07.227Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-837add07ec4e08aae797e043: start","job_status":"start","queue_duration_s":2.200172,"scheduling_latency_s":2.20019} gitlab # [ 234.989058] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.449Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"837add07ec4e08aae797e043","created_at":"2026-09-03T10:30:07.210Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"627cec328af9bb144b0c829d75564613","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:07.227Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-837add07ec4e08aae797e043: done: 0.021775 sec","job_status":"done","queue_duration_s":2.200172,"scheduling_latency_s":2.20019,"redis_calls":12,"redis_duration_s":0.001817,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000294,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000848,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000675,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026836,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.021775,"completed_at":"2026-09-03T10:30:09.449Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000637,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.033562] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5ba37d0be152d82d94e68e9","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5ba37d0be152d82d94e68e9: start","job_status":"start","queue_duration_s":0.451331,"scheduling_latency_s":0.451348} gitlab # [ 235.045706] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5ba37d0be152d82d94e68e9","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5ba37d0be152d82d94e68e9: done: 0.025717 sec","job_status":"done","queue_duration_s":0.451331,"scheduling_latency_s":0.451348,"redis_calls":16,"redis_duration_s":0.002235,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000403,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000639,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001193,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024734,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025717,"completed_at":"2026-09-03T10:30:09.476Z","load_balancing_strategy":"primary","db_duration_s":0.000713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.087094] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.477Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23a592ef324880d7f34610ea","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23a592ef324880d7f34610ea: start","job_status":"start","queue_duration_s":0.478191,"scheduling_latency_s":0.478207} gitlab # [ 235.099272] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23a592ef324880d7f34610ea","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23a592ef324880d7f34610ea: done: 0.016675 sec","job_status":"done","queue_duration_s":0.478191,"scheduling_latency_s":0.478207,"redis_calls":13,"redis_duration_s":0.001974,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001392,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016675,"completed_at":"2026-09-03T10:30:09.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.137999] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd7106fc2f8bab4be21cc569","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd7106fc2f8bab4be21cc569: start","job_status":"start","queue_duration_s":0.496028,"scheduling_latency_s":0.496046} gitlab # [ 235.150096] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd7106fc2f8bab4be21cc569","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd7106fc2f8bab4be21cc569: done: 0.017209 sec","job_status":"done","queue_duration_s":0.496028,"scheduling_latency_s":0.496046,"redis_calls":13,"redis_duration_s":0.0018210000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017209,"completed_at":"2026-09-03T10:30:09.512Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.188168] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"907f6e0bc5c7ded77ed4d719","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-907f6e0bc5c7ded77ed4d719: start","job_status":"start","queue_duration_s":0.514397,"scheduling_latency_s":0.514415} gitlab # [ 235.200244] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"907f6e0bc5c7ded77ed4d719","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-907f6e0bc5c7ded77ed4d719: done: 0.016413 sec","job_status":"done","queue_duration_s":0.514397,"scheduling_latency_s":0.514415,"redis_calls":13,"redis_duration_s":0.001574,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000572,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010947,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016413,"completed_at":"2026-09-03T10:30:09.530Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.239204] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"495e18a248582e8ebbc8d90b","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-495e18a248582e8ebbc8d90b: start","job_status":"start","queue_duration_s":0.531968,"scheduling_latency_s":0.531984} gitlab # [ 235.251495] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"495e18a248582e8ebbc8d90b","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-495e18a248582e8ebbc8d90b: done: 0.016507 sec","job_status":"done","queue_duration_s":0.531968,"scheduling_latency_s":0.531984,"redis_calls":13,"redis_duration_s":0.002063,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016507,"completed_at":"2026-09-03T10:30:09.547Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.290730] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1705d996fc524099372dc196","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1705d996fc524099372dc196: start","job_status":"start","queue_duration_s":0.550149,"scheduling_latency_s":0.550167} gitlab # [ 235.303021] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1705d996fc524099372dc196","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1705d996fc524099372dc196: done: 0.016085 sec","job_status":"done","queue_duration_s":0.550149,"scheduling_latency_s":0.550167,"redis_calls":13,"redis_duration_s":0.001614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016085,"completed_at":"2026-09-03T10:30:09.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.341867] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6552c053a98b5e4e422db4e9","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6552c053a98b5e4e422db4e9: start","job_status":"start","queue_duration_s":0.567841,"scheduling_latency_s":0.567858} gitlab # [ 235.354240] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6552c053a98b5e4e422db4e9","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6552c053a98b5e4e422db4e9: done: 0.015887 sec","job_status":"done","queue_duration_s":0.567841,"scheduling_latency_s":0.567858,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015887,"completed_at":"2026-09-03T10:30:09.583Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.392611] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.584Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a22ec19514bfe00c43f93675","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a22ec19514bfe00c43f93675: start","job_status":"start","queue_duration_s":0.585453,"scheduling_latency_s":0.58547} gitlab # [ 235.404556] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a22ec19514bfe00c43f93675","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a22ec19514bfe00c43f93675: done: 0.017807 sec","job_status":"done","queue_duration_s":0.585453,"scheduling_latency_s":0.58547,"redis_calls":13,"redis_duration_s":0.001571,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013202,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017807,"completed_at":"2026-09-03T10:30:09.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.443063] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c482d0c3b16b8aa5b628dfe","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c482d0c3b16b8aa5b628dfe: start","job_status":"start","queue_duration_s":0.604815,"scheduling_latency_s":0.604833} gitlab # [ 235.455438] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.620Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c482d0c3b16b8aa5b628dfe","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c482d0c3b16b8aa5b628dfe: done: 0.016331 sec","job_status":"done","queue_duration_s":0.604815,"scheduling_latency_s":0.604833,"redis_calls":13,"redis_duration_s":0.001542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011477,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016331,"completed_at":"2026-09-03T10:30:09.620Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.494915] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9abe884e69e6399eb354f85a","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9abe884e69e6399eb354f85a: start","job_status":"start","queue_duration_s":0.622649,"scheduling_latency_s":0.622668} gitlab # [ 235.507280] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9abe884e69e6399eb354f85a","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9abe884e69e6399eb354f85a: done: 0.016066 sec","job_status":"done","queue_duration_s":0.622649,"scheduling_latency_s":0.622668,"redis_calls":13,"redis_duration_s":0.0015500000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000995,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016066,"completed_at":"2026-09-03T10:30:09.638Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.546588] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9bc5adb4fd41ff22e61ccc8","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9bc5adb4fd41ff22e61ccc8: start","job_status":"start","queue_duration_s":0.639878,"scheduling_latency_s":0.639896} gitlab # [ 235.559041] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9bc5adb4fd41ff22e61ccc8","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9bc5adb4fd41ff22e61ccc8: done: 0.017471 sec","job_status":"done","queue_duration_s":0.639878,"scheduling_latency_s":0.639896,"redis_calls":13,"redis_duration_s":0.001691,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000585,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012168,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017471,"completed_at":"2026-09-03T10:30:09.656Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.598697] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"473ee032f05a3051f2961b29","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-473ee032f05a3051f2961b29: start","job_status":"start","queue_duration_s":0.658471,"scheduling_latency_s":0.658487} gitlab # [ 235.611194] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"473ee032f05a3051f2961b29","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-473ee032f05a3051f2961b29: done: 0.017072 sec","job_status":"done","queue_duration_s":0.658471,"scheduling_latency_s":0.658487,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017072,"completed_at":"2026-09-03T10:30:09.674Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.649944] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fff3435187ea9af72f2ad1ef","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fff3435187ea9af72f2ad1ef: start","job_status":"start","queue_duration_s":0.676765,"scheduling_latency_s":0.676782} gitlab # [ 235.662320] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fff3435187ea9af72f2ad1ef","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fff3435187ea9af72f2ad1ef: done: 0.014732 sec","job_status":"done","queue_duration_s":0.676765,"scheduling_latency_s":0.676782,"redis_calls":13,"redis_duration_s":0.001548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014732,"completed_at":"2026-09-03T10:30:09.690Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.701723] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8480f37e6d04f238acc6bb2a","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8480f37e6d04f238acc6bb2a: start","job_status":"start","queue_duration_s":0.692758,"scheduling_latency_s":0.692776} gitlab # [ 235.713957] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8480f37e6d04f238acc6bb2a","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8480f37e6d04f238acc6bb2a: done: 0.014564 sec","job_status":"done","queue_duration_s":0.692758,"scheduling_latency_s":0.692776,"redis_calls":13,"redis_duration_s":0.001465,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014564,"completed_at":"2026-09-03T10:30:09.706Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.752736] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2727e73787a3e2335f278359","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2727e73787a3e2335f278359: start","job_status":"start","queue_duration_s":0.708534,"scheduling_latency_s":0.708552} gitlab # [ 235.764852] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2727e73787a3e2335f278359","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2727e73787a3e2335f278359: done: 0.014364 sec","job_status":"done","queue_duration_s":0.708534,"scheduling_latency_s":0.708552,"redis_calls":13,"redis_duration_s":0.001511,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000975,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014364,"completed_at":"2026-09-03T10:30:09.722Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.803270] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccde28efa6e42ebf6e14c44a","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccde28efa6e42ebf6e14c44a: start","job_status":"start","queue_duration_s":0.724201,"scheduling_latency_s":0.72425} gitlab # [ 235.815666] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccde28efa6e42ebf6e14c44a","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccde28efa6e42ebf6e14c44a: done: 0.014602 sec","job_status":"done","queue_duration_s":0.724201,"scheduling_latency_s":0.72425,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014602,"completed_at":"2026-09-03T10:30:09.738Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.854400] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b6913295ff61f82e691be88","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b6913295ff61f82e691be88: start","job_status":"start","queue_duration_s":0.739998,"scheduling_latency_s":0.740015} gitlab # [ 235.866583] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b6913295ff61f82e691be88","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b6913295ff61f82e691be88: done: 0.014606 sec","job_status":"done","queue_duration_s":0.739998,"scheduling_latency_s":0.740015,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014606,"completed_at":"2026-09-03T10:30:09.753Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.906316] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.755Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9d20eef2c0cf459f8b74631","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9d20eef2c0cf459f8b74631: start","job_status":"start","queue_duration_s":0.755825,"scheduling_latency_s":0.755843} gitlab # [ 235.918635] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9d20eef2c0cf459f8b74631","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9d20eef2c0cf459f8b74631: done: 0.014562 sec","job_status":"done","queue_duration_s":0.755825,"scheduling_latency_s":0.755843,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014562,"completed_at":"2026-09-03T10:30:09.769Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.956886] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.771Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eda32ac5d8feecbc0dea397b","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eda32ac5d8feecbc0dea397b: start","job_status":"start","queue_duration_s":0.771726,"scheduling_latency_s":0.771744} gitlab # [ 235.969040] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eda32ac5d8feecbc0dea397b","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eda32ac5d8feecbc0dea397b: done: 0.01453 sec","job_status":"done","queue_duration_s":0.771726,"scheduling_latency_s":0.771744,"redis_calls":13,"redis_duration_s":0.0014880000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009997,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01453,"completed_at":"2026-09-03T10:30:09.785Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.007414] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.786Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0156dbb2ebef1aa01ef0f31d","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0156dbb2ebef1aa01ef0f31d: start","job_status":"start","queue_duration_s":0.787451,"scheduling_latency_s":0.787468} gitlab # [ 236.019613] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0156dbb2ebef1aa01ef0f31d","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0156dbb2ebef1aa01ef0f31d: done: 0.014391 sec","job_status":"done","queue_duration_s":0.787451,"scheduling_latency_s":0.787468,"redis_calls":13,"redis_duration_s":0.001475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014391,"completed_at":"2026-09-03T10:30:09.801Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.058417] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"548eed57694ac835cfd77243","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-548eed57694ac835cfd77243: start","job_status":"start","queue_duration_s":0.803013,"scheduling_latency_s":0.803029} gitlab # [ 236.070644] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.817Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"548eed57694ac835cfd77243","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-548eed57694ac835cfd77243: done: 0.015041 sec","job_status":"done","queue_duration_s":0.803013,"scheduling_latency_s":0.803029,"redis_calls":13,"redis_duration_s":0.001783,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001208,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015041,"completed_at":"2026-09-03T10:30:09.817Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.109960] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1da8ed3d199241b90240d392","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1da8ed3d199241b90240d392: start","job_status":"start","queue_duration_s":0.819244,"scheduling_latency_s":0.819261} gitlab # [ 236.122223] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1da8ed3d199241b90240d392","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1da8ed3d199241b90240d392: done: 0.014352 sec","job_status":"done","queue_duration_s":0.819244,"scheduling_latency_s":0.819261,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014352,"completed_at":"2026-09-03T10:30:09.832Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.160408] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.834Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e3711ddeed4fdfd20eed7c5","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e3711ddeed4fdfd20eed7c5: start","job_status":"start","queue_duration_s":0.834787,"scheduling_latency_s":0.834804} gitlab # [ 236.172542] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0e3711ddeed4fdfd20eed7c5","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0e3711ddeed4fdfd20eed7c5: done: 0.01488 sec","job_status":"done","queue_duration_s":0.834787,"scheduling_latency_s":0.834804,"redis_calls":13,"redis_duration_s":0.0016259999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000628,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000998,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01029,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01488,"completed_at":"2026-09-03T10:30:09.849Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.210779] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f8cccf72c13983ec7653940","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f8cccf72c13983ec7653940: start","job_status":"start","queue_duration_s":0.85093,"scheduling_latency_s":0.850948} gitlab # [ 236.223061] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f8cccf72c13983ec7653940","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f8cccf72c13983ec7653940: done: 0.014642 sec","job_status":"done","queue_duration_s":0.85093,"scheduling_latency_s":0.850948,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014642,"completed_at":"2026-09-03T10:30:09.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.261252] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"185db7e3978ee39bf97746a1","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-185db7e3978ee39bf97746a1: start","job_status":"start","queue_duration_s":0.866751,"scheduling_latency_s":0.866769} gitlab # [ 236.273352] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"185db7e3978ee39bf97746a1","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-185db7e3978ee39bf97746a1: done: 0.014336 sec","job_status":"done","queue_duration_s":0.866751,"scheduling_latency_s":0.866769,"redis_calls":13,"redis_duration_s":0.001465,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014336,"completed_at":"2026-09-03T10:30:09.880Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.312728] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afb618847863f72f6176dc3f","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afb618847863f72f6176dc3f: start","job_status":"start","queue_duration_s":0.882266,"scheduling_latency_s":0.882284} gitlab # [ 236.324791] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"afb618847863f72f6176dc3f","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-afb618847863f72f6176dc3f: done: 0.014636 sec","job_status":"done","queue_duration_s":0.882266,"scheduling_latency_s":0.882284,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010123,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014636,"completed_at":"2026-09-03T10:30:09.896Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.362963] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de194b0741e958836072e867","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de194b0741e958836072e867: start","job_status":"start","queue_duration_s":0.898157,"scheduling_latency_s":0.898174} gitlab # [ 236.375280] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.912Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de194b0741e958836072e867","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de194b0741e958836072e867: done: 0.014646 sec","job_status":"done","queue_duration_s":0.898157,"scheduling_latency_s":0.898174,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014646,"completed_at":"2026-09-03T10:30:09.912Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.413879] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"332da37d5edcac65b4ef99a5","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-332da37d5edcac65b4ef99a5: start","job_status":"start","queue_duration_s":0.914018,"scheduling_latency_s":0.914035} gitlab # [ 236.426082] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"332da37d5edcac65b4ef99a5","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-332da37d5edcac65b4ef99a5: done: 0.014456 sec","job_status":"done","queue_duration_s":0.914018,"scheduling_latency_s":0.914035,"redis_calls":13,"redis_duration_s":0.0014780000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014456,"completed_at":"2026-09-03T10:30:09.927Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.464419] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"966945b136df7eb677015552","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-966945b136df7eb677015552: start","job_status":"start","queue_duration_s":0.929702,"scheduling_latency_s":0.92972} gitlab # [ 236.476586] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"966945b136df7eb677015552","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-966945b136df7eb677015552: done: 0.015112 sec","job_status":"done","queue_duration_s":0.929702,"scheduling_latency_s":0.92972,"redis_calls":13,"redis_duration_s":0.001526,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010044,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015112,"completed_at":"2026-09-03T10:30:09.944Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.516159] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a64cb37e9dd972fae5649f2f","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a64cb37e9dd972fae5649f2f: start","job_status":"start","queue_duration_s":0.945987,"scheduling_latency_s":0.946004} gitlab # [ 236.527986] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a64cb37e9dd972fae5649f2f","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a64cb37e9dd972fae5649f2f: done: 0.014301 sec","job_status":"done","queue_duration_s":0.945987,"scheduling_latency_s":0.946004,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009847,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014301,"completed_at":"2026-09-03T10:30:09.959Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.566538] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b513e3118c199f9dfeac2e3","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b513e3118c199f9dfeac2e3: start","job_status":"start","queue_duration_s":0.961489,"scheduling_latency_s":0.961506} gitlab # [ 236.578768] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b513e3118c199f9dfeac2e3","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b513e3118c199f9dfeac2e3: done: 0.014481 sec","job_status":"done","queue_duration_s":0.961489,"scheduling_latency_s":0.961506,"redis_calls":13,"redis_duration_s":0.001577,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000616,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014481,"completed_at":"2026-09-03T10:30:09.975Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.617910] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d9990c28d443aae80b23464","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d9990c28d443aae80b23464: start","job_status":"start","queue_duration_s":0.977184,"scheduling_latency_s":0.977201} gitlab # [ 236.629927] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d9990c28d443aae80b23464","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d9990c28d443aae80b23464: done: 0.014556 sec","job_status":"done","queue_duration_s":0.977184,"scheduling_latency_s":0.977201,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014556,"completed_at":"2026-09-03T10:30:09.991Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.668920] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:09.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c13c4ae90162c0c152ef541f","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c13c4ae90162c0c152ef541f: start","job_status":"start","queue_duration_s":0.992919,"scheduling_latency_s":0.992936} gitlab # [ 236.681381] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.006Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c13c4ae90162c0c152ef541f","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c13c4ae90162c0c152ef541f: done: 0.014404 sec","job_status":"done","queue_duration_s":0.992919,"scheduling_latency_s":0.992936,"redis_calls":13,"redis_duration_s":0.0015019999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009977,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014404,"completed_at":"2026-09-03T10:30:10.006Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.721191] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e06955cfa6b903f623e03706","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e06955cfa6b903f623e03706: start","job_status":"start","queue_duration_s":1.008542,"scheduling_latency_s":1.008561} gitlab # [ 236.733422] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e06955cfa6b903f623e03706","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e06955cfa6b903f623e03706: done: 0.015016 sec","job_status":"done","queue_duration_s":1.008542,"scheduling_latency_s":1.008561,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015016,"completed_at":"2026-09-03T10:30:10.022Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.771831] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.024Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5c5da5548ebf831c947f886","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5c5da5548ebf831c947f886: start","job_status":"start","queue_duration_s":1.024848,"scheduling_latency_s":1.024867} gitlab # [ 236.784264] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5c5da5548ebf831c947f886","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5c5da5548ebf831c947f886: done: 0.01472 sec","job_status":"done","queue_duration_s":1.024848,"scheduling_latency_s":1.024867,"redis_calls":13,"redis_duration_s":0.0015040000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01472,"completed_at":"2026-09-03T10:30:10.038Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.822904] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eefe36a15b8b0e036f2c5f2b","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eefe36a15b8b0e036f2c5f2b: start","job_status":"start","queue_duration_s":1.040773,"scheduling_latency_s":1.04079} gitlab # [ 236.835283] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eefe36a15b8b0e036f2c5f2b","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eefe36a15b8b0e036f2c5f2b: done: 0.014435 sec","job_status":"done","queue_duration_s":1.040773,"scheduling_latency_s":1.04079,"redis_calls":13,"redis_duration_s":0.0015509999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000628,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014435,"completed_at":"2026-09-03T10:30:10.054Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.873857] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f12bf538c38854afc8d9f77","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f12bf538c38854afc8d9f77: start","job_status":"start","queue_duration_s":1.05649,"scheduling_latency_s":1.056509} gitlab # [ 236.886118] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f12bf538c38854afc8d9f77","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f12bf538c38854afc8d9f77: done: 0.01462 sec","job_status":"done","queue_duration_s":1.05649,"scheduling_latency_s":1.056509,"redis_calls":13,"redis_duration_s":0.001554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000581,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01462,"completed_at":"2026-09-03T10:30:10.070Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.925621] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb6ea0108fd696bcefa8084d","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb6ea0108fd696bcefa8084d: start","job_status":"start","queue_duration_s":1.072304,"scheduling_latency_s":1.072321} gitlab # [ 236.937772] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb6ea0108fd696bcefa8084d","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb6ea0108fd696bcefa8084d: done: 0.014298 sec","job_status":"done","queue_duration_s":1.072304,"scheduling_latency_s":1.072321,"redis_calls":13,"redis_duration_s":0.001497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014298,"completed_at":"2026-09-03T10:30:10.085Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.976190] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbfed96c9d7e481e945995d9","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbfed96c9d7e481e945995d9: start","job_status":"start","queue_duration_s":1.08787,"scheduling_latency_s":1.087887} gitlab # [ 236.988308] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbfed96c9d7e481e945995d9","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbfed96c9d7e481e945995d9: done: 0.014532 sec","job_status":"done","queue_duration_s":1.08787,"scheduling_latency_s":1.087887,"redis_calls":13,"redis_duration_s":0.001522,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014532,"completed_at":"2026-09-03T10:30:10.101Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.026778] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cc0369dbf34e58b1da26ba1","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cc0369dbf34e58b1da26ba1: start","job_status":"start","queue_duration_s":1.103666,"scheduling_latency_s":1.103683} gitlab # [ 237.038944] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.118Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7cc0369dbf34e58b1da26ba1","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7cc0369dbf34e58b1da26ba1: done: 0.015211 sec","job_status":"done","queue_duration_s":1.103666,"scheduling_latency_s":1.103683,"redis_calls":13,"redis_duration_s":0.0015370000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015211,"completed_at":"2026-09-03T10:30:10.118Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.077981] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.119Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dd460a97c63e89ca0b253e8","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dd460a97c63e89ca0b253e8: start","job_status":"start","queue_duration_s":1.120064,"scheduling_latency_s":1.120081} gitlab # [ 237.090259] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.415Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6dd460a97c63e89ca0b253e8","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6dd460a97c63e89ca0b253e8: done: 0.295992 sec","job_status":"done","queue_duration_s":1.120064,"scheduling_latency_s":1.120081,"redis_calls":13,"redis_duration_s":0.007169,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00224,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.295992,"completed_at":"2026-09-03T10:30:10.415Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.129656] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cae1e317659c42acbffbe50c","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cae1e317659c42acbffbe50c: start","job_status":"start","queue_duration_s":1.41801,"scheduling_latency_s":1.418032} gitlab # [ 237.141860] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cae1e317659c42acbffbe50c","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cae1e317659c42acbffbe50c: done: 0.022003 sec","job_status":"done","queue_duration_s":1.41801,"scheduling_latency_s":1.418032,"redis_calls":13,"redis_duration_s":0.0066960000000000006,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001146,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00555,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022003,"completed_at":"2026-09-03T10:30:10.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.180477] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d4c78cbf91891d2db85a485","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d4c78cbf91891d2db85a485: start","job_status":"start","queue_duration_s":1.442239,"scheduling_latency_s":1.442258} gitlab # [ 237.192827] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d4c78cbf91891d2db85a485","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d4c78cbf91891d2db85a485: done: 0.0171 sec","job_status":"done","queue_duration_s":1.442239,"scheduling_latency_s":1.442258,"redis_calls":13,"redis_duration_s":0.0021190000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001041,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0171,"completed_at":"2026-09-03T10:30:10.458Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.231128] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fee2882fd380f9e5ad4a04b","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fee2882fd380f9e5ad4a04b: start","job_status":"start","queue_duration_s":1.460539,"scheduling_latency_s":1.460556} gitlab # [ 237.243511] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fee2882fd380f9e5ad4a04b","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fee2882fd380f9e5ad4a04b: done: 0.014871 sec","job_status":"done","queue_duration_s":1.460539,"scheduling_latency_s":1.460556,"redis_calls":13,"redis_duration_s":0.0014689999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014871,"completed_at":"2026-09-03T10:30:10.474Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.282189] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"498f34e6877e63eac3284d3f","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-498f34e6877e63eac3284d3f: start","job_status":"start","queue_duration_s":1.476575,"scheduling_latency_s":1.476592} gitlab # [ 237.294548] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"498f34e6877e63eac3284d3f","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-498f34e6877e63eac3284d3f: done: 0.016162 sec","job_status":"done","queue_duration_s":1.476575,"scheduling_latency_s":1.476592,"redis_calls":13,"redis_duration_s":0.001597,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000607,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016162,"completed_at":"2026-09-03T10:30:10.492Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.333949] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8320fd32f9ade26236e3f1f6","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8320fd32f9ade26236e3f1f6: start","job_status":"start","queue_duration_s":1.493857,"scheduling_latency_s":1.493873} gitlab # [ 237.345939] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8320fd32f9ade26236e3f1f6","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8320fd32f9ade26236e3f1f6: done: 0.014977 sec","job_status":"done","queue_duration_s":1.493857,"scheduling_latency_s":1.493873,"redis_calls":13,"redis_duration_s":0.001478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014977,"completed_at":"2026-09-03T10:30:10.508Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.384400] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.509Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5cc49b17256573efd991399","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5cc49b17256573efd991399: start","job_status":"start","queue_duration_s":1.509933,"scheduling_latency_s":1.50995} gitlab # [ 237.396604] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5cc49b17256573efd991399","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5cc49b17256573efd991399: done: 0.015346 sec","job_status":"done","queue_duration_s":1.509933,"scheduling_latency_s":1.50995,"redis_calls":13,"redis_duration_s":0.001552,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015346,"completed_at":"2026-09-03T10:30:10.524Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.434737] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.525Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fda103e514b25644755773ce","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fda103e514b25644755773ce: start","job_status":"start","queue_duration_s":1.526501,"scheduling_latency_s":1.52652} gitlab # [ 237.447105] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fda103e514b25644755773ce","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fda103e514b25644755773ce: done: 0.016001 sec","job_status":"done","queue_duration_s":1.526501,"scheduling_latency_s":1.52652,"redis_calls":13,"redis_duration_s":0.002242,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001311,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016001,"completed_at":"2026-09-03T10:30:10.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.485863] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5e7a5b75e5579095e38a8d0","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5e7a5b75e5579095e38a8d0: start","job_status":"start","queue_duration_s":1.5436,"scheduling_latency_s":1.543617} gitlab # [ 237.498153] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5e7a5b75e5579095e38a8d0","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5e7a5b75e5579095e38a8d0: done: 0.014693 sec","job_status":"done","queue_duration_s":1.5436,"scheduling_latency_s":1.543617,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014693,"completed_at":"2026-09-03T10:30:10.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.537607] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d90882eeccaa030ed089b5c","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d90882eeccaa030ed089b5c: start","job_status":"start","queue_duration_s":1.559435,"scheduling_latency_s":1.559452} gitlab # [ 237.549803] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d90882eeccaa030ed089b5c","created_at":"2026-09-03T10:30:08.911Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cabda2da56ce4e68","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"614479bd7a39fd2242cf343073b2e1dc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:30:08.999Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d90882eeccaa030ed089b5c: done: 0.016056 sec","job_status":"done","queue_duration_s":1.559435,"scheduling_latency_s":1.559452,"redis_calls":13,"redis_duration_s":0.001508,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016056,"completed_at":"2026-09-03T10:30:10.574Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.588162] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.576Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"529ca74466b055ec694e57b6","created_at":"2026-09-03T10:30:09.131Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-5cce8673f2ad47d3","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"9648621e19ae37a742d3003163a7ec6c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:09.140Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-529ca74466b055ec694e57b6: start","job_status":"start","queue_duration_s":1.435561,"scheduling_latency_s":1.435577} gitlab # [ 237.602862] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.600Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"529ca74466b055ec694e57b6","created_at":"2026-09-03T10:30:09.131Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-5cce8673f2ad47d3","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"9648621e19ae37a742d3003163a7ec6c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:09.140Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-529ca74466b055ec694e57b6: done: 0.024527 sec","job_status":"done","queue_duration_s":1.435561,"scheduling_latency_s":1.435577,"redis_calls":10,"redis_duration_s":0.002282,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00032,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001685,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000277,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015715,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027758,"duration_s":0.024527,"completed_at":"2026-09-03T10:30:10.600Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002326,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.644877] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.601Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"e4cb7d043080d78fb5a914f3","created_at":"2026-09-03T10:30:09.141Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-5cce8673f2ad47d3","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"9648621e19ae37a742d3003163a7ec6c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:09.146Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-e4cb7d043080d78fb5a914f3: start","job_status":"start","queue_duration_s":1.455282,"scheduling_latency_s":1.455297} gitlab # [ 237.660097] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:30:10.623Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"e4cb7d043080d78fb5a914f3","created_at":"2026-09-03T10:30:09.141Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-5cce8673f2ad47d3","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"9648621e19ae37a742d3003163a7ec6c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-09-03T10:30:09.146Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-e4cb7d043080d78fb5a914f3: done: 0.021621 sec","job_status":"done","queue_duration_s":1.455282,"scheduling_latency_s":1.455297,"redis_calls":10,"redis_duration_s":0.001399,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000809,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000312,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024444,"duration_s":0.021621,"completed_at":"2026-09-03T10:30:10.623Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000806,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 264.077729] setup-gitlab-start[2912]: W, [2026-09-03T10:30:38.947941 #2912] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 289.228614] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.097Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"99dd3383f4eb9e7be2134a17","created_at":"2026-09-03T10:31:04.073Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"502855a5d8d5c779145e325c0aed2104","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.093Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-99dd3383f4eb9e7be2134a17: start","job_status":"start","queue_duration_s":0.004293,"scheduling_latency_s":0.00435} gitlab # [ 289.566652] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"99dd3383f4eb9e7be2134a17","created_at":"2026-09-03T10:31:04.073Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"502855a5d8d5c779145e325c0aed2104","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.093Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-99dd3383f4eb9e7be2134a17: done: 0.33937 sec","job_status":"done","queue_duration_s":0.004293,"scheduling_latency_s":0.00435,"redis_calls":21,"redis_duration_s":0.076843,"redis_read_bytes":911,"redis_write_bytes":4479,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.044232,"redis_feature_flag_read_bytes":896,"redis_feature_flag_write_bytes":449,"redis_queues_calls":2,"redis_queues_duration_s":0.001432,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.027287,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.003892,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.104987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.33937,"completed_at":"2026-09-03T10:31:04.436Z","load_balancing_strategy":"primary","db_duration_s":0.007996,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 289.657940] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.450Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6a51e06f2a95f992183fdedd","created_at":"2026-09-03T10:31:04.175Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62d7bcc952e023fb7558f046754ce60d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.181Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6a51e06f2a95f992183fdedd: start","job_status":"start","queue_duration_s":0.268746,"scheduling_latency_s":0.268799} gitlab # [ 289.719456] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.589Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"6a51e06f2a95f992183fdedd","created_at":"2026-09-03T10:31:04.175Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62d7bcc952e023fb7558f046754ce60d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.181Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-6a51e06f2a95f992183fdedd: done: 0.139385 sec","job_status":"done","queue_duration_s":0.268746,"scheduling_latency_s":0.268799,"redis_calls":8,"redis_duration_s":0.039028,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000529,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.032686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005813,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.139385,"completed_at":"2026-09-03T10:31:04.589Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 289.798966] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6da1781e6241920fbe223f9b","created_at":"2026-09-03T10:31:04.193Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e46224c81480fad8c32ac93da8f6a5e6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.198Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6da1781e6241920fbe223f9b: start","job_status":"start","queue_duration_s":0.39629,"scheduling_latency_s":0.396333} gitlab # [ 289.815500] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.628Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 289.819631] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"6da1781e6241920fbe223f9b","created_at":"2026-09-03T10:31:04.193Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e46224c81480fad8c32ac93da8f6a5e6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.198Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-6da1781e6241920fbe223f9b: done: 0.066431 sec","job_status":"done","queue_duration_s":0.39629,"scheduling_latency_s":0.396333,"redis_calls":7,"redis_duration_s":0.004872,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002979,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001893,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.066431,"completed_at":"2026-09-03T10:31:04.661Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 289.862311] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.667Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"41074f1779916dd49113a14d","created_at":"2026-09-03T10:31:04.235Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4dc567dae32a9a8ea3d24ea1163ff5a0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.246Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-41074f1779916dd49113a14d: start","job_status":"start","queue_duration_s":0.421681,"scheduling_latency_s":0.42173} gitlab # [ 289.877004] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.690Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 289.880193] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.724Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"41074f1779916dd49113a14d","created_at":"2026-09-03T10:31:04.235Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4dc567dae32a9a8ea3d24ea1163ff5a0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.246Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-41074f1779916dd49113a14d: done: 0.057205 sec","job_status":"done","queue_duration_s":0.421681,"scheduling_latency_s":0.42173,"redis_calls":7,"redis_duration_s":0.002453,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0018,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000653,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.057205,"completed_at":"2026-09-03T10:31:04.724Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 289.919931] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.729Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"853296b4d5a4aed7a2534c4f","created_at":"2026-09-03T10:31:04.277Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94a6c0de2135e09d22d636ba2f335af3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:31:04.283Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-853296b4d5a4aed7a2534c4f: start","job_status":"start","queue_duration_s":0.445335,"scheduling_latency_s":0.445382} gitlab # [ 289.933240] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.754Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 289.963923] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.835Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"853296b4d5a4aed7a2534c4f","created_at":"2026-09-03T10:31:04.277Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94a6c0de2135e09d22d636ba2f335af3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:31:04.283Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-853296b4d5a4aed7a2534c4f: done: 0.105843 sec","job_status":"done","queue_duration_s":0.445335,"scheduling_latency_s":0.445382,"redis_calls":7,"redis_duration_s":0.002613,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00185,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000763,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.105843,"completed_at":"2026-09-03T10:31:04.834Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.003572] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.841Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c0f72bd429b4b24222a4592a","created_at":"2026-09-03T10:31:04.354Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f5e8e69edb768c50ca995d22f533cd9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.369Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c0f72bd429b4b24222a4592a: start","job_status":"start","queue_duration_s":0.471786,"scheduling_latency_s":0.471832} gitlab # [ 290.018250] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.879Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 290.039423] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.909Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c0f72bd429b4b24222a4592a","created_at":"2026-09-03T10:31:04.354Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f5e8e69edb768c50ca995d22f533cd9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.369Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c0f72bd429b4b24222a4592a: done: 0.068283 sec","job_status":"done","queue_duration_s":0.471786,"scheduling_latency_s":0.471832,"redis_calls":7,"redis_duration_s":0.007573,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005634,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001939,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.068283,"completed_at":"2026-09-03T10:31:04.909Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.080450] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:04.913Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ba6199f3f9a5373a394fe47b","created_at":"2026-09-03T10:31:04.287Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-6044ebf2355f4aaa","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"502855a5d8d5c779145e325c0aed2104","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.372Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ba6199f3f9a5373a394fe47b: start","job_status":"start","queue_duration_s":0.540839,"scheduling_latency_s":0.540877} gitlab # [ 290.172873] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.044Z","message":"No existing merge request to be cleaned up."} gitlab # [ 290.223466] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.093Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ba6199f3f9a5373a394fe47b","created_at":"2026-09-03T10:31:04.287Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-6044ebf2355f4aaa","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"502855a5d8d5c779145e325c0aed2104","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.372Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ba6199f3f9a5373a394fe47b: done: 0.180798 sec","job_status":"done","queue_duration_s":0.540839,"scheduling_latency_s":0.540877,"redis_calls":10,"redis_duration_s":0.022377,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.012704,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.009673,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.008,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.180798,"completed_at":"2026-09-03T10:31:05.093Z","load_balancing_strategy":"primary","db_duration_s":0.043604,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.309914] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.097Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9e8705f44d7c256cff893742","created_at":"2026-09-03T10:31:04.287Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-6044ebf2355f4aaa","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"502855a5d8d5c779145e325c0aed2104","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.372Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9e8705f44d7c256cff893742: start","job_status":"start","queue_duration_s":0.725425,"scheduling_latency_s":0.725471} gitlab # [ 290.345981] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.134Z","message":"No existing merge request to be cleaned up."} gitlab # [ 290.350382] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.154Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9e8705f44d7c256cff893742","created_at":"2026-09-03T10:31:04.287Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-6044ebf2355f4aaa","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"502855a5d8d5c779145e325c0aed2104","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.372Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9e8705f44d7c256cff893742: done: 0.057036 sec","job_status":"done","queue_duration_s":0.725425,"scheduling_latency_s":0.725471,"redis_calls":10,"redis_duration_s":0.009682,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.006834,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002848,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.057036,"completed_at":"2026-09-03T10:31:05.154Z","load_balancing_strategy":"primary","db_duration_s":0.006979,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.409708] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.158Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bc64c88c197dd01da0a9ce0c","created_at":"2026-09-03T10:31:04.287Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-6044ebf2355f4aaa","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"502855a5d8d5c779145e325c0aed2104","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.372Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bc64c88c197dd01da0a9ce0c: start","job_status":"start","queue_duration_s":0.785844,"scheduling_latency_s":0.785878} gitlab # [ 290.423143] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.179Z","message":"No existing merge request to be cleaned up."} gitlab # [ 290.425017] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.193Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"bc64c88c197dd01da0a9ce0c","created_at":"2026-09-03T10:31:04.287Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-6044ebf2355f4aaa","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"502855a5d8d5c779145e325c0aed2104","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.372Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-bc64c88c197dd01da0a9ce0c: done: 0.035787 sec","job_status":"done","queue_duration_s":0.785844,"scheduling_latency_s":0.785878,"redis_calls":10,"redis_duration_s":0.003125,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001211,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001914,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035787,"completed_at":"2026-09-03T10:31:05.193Z","load_balancing_strategy":"primary","db_duration_s":0.0029,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.463846] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.195Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c5385b6790dea12876699692","created_at":"2026-09-03T10:31:04.287Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-6044ebf2355f4aaa","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"502855a5d8d5c779145e325c0aed2104","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.372Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c5385b6790dea12876699692: start","job_status":"start","queue_duration_s":0.823625,"scheduling_latency_s":0.823652} gitlab # [ 290.476033] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.213Z","message":"No existing merge request to be cleaned up."} gitlab # [ 290.477642] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.224Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c5385b6790dea12876699692","created_at":"2026-09-03T10:31:04.287Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-6044ebf2355f4aaa","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"502855a5d8d5c779145e325c0aed2104","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.372Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c5385b6790dea12876699692: done: 0.028985 sec","job_status":"done","queue_duration_s":0.823625,"scheduling_latency_s":0.823652,"redis_calls":10,"redis_duration_s":0.0021590000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001231,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02017,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028985,"completed_at":"2026-09-03T10:31:05.224Z","load_balancing_strategy":"primary","db_duration_s":0.002717,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.515855] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.226Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"8139e726c73ddc8295d6820d","created_at":"2026-09-03T10:31:04.397Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89e6b9396d9641059dfd595e195f3616","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.406Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-8139e726c73ddc8295d6820d: start","job_status":"start","queue_duration_s":0.820529,"scheduling_latency_s":0.820552} gitlab # [ 290.664470] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.535Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"8139e726c73ddc8295d6820d","created_at":"2026-09-03T10:31:04.397Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89e6b9396d9641059dfd595e195f3616","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.406Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-8139e726c73ddc8295d6820d: done: 0.308608 sec","job_status":"done","queue_duration_s":0.820529,"scheduling_latency_s":0.820552,"redis_calls":562,"redis_duration_s":0.05571,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.054805,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.288016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.308608,"completed_at":"2026-09-03T10:31:05.535Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.704082] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.537Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7cb84a021e08931e3f7c5968","created_at":"2026-09-03T10:31:04.438Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae01c1f7a51f20bbe231b1e70b173e81","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.444Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7cb84a021e08931e3f7c5968: start","job_status":"start","queue_duration_s":1.092348,"scheduling_latency_s":1.092369} gitlab # [ 290.731065] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.601Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"7cb84a021e08931e3f7c5968","created_at":"2026-09-03T10:31:04.438Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae01c1f7a51f20bbe231b1e70b173e81","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.444Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-7cb84a021e08931e3f7c5968: done: 0.064612 sec","job_status":"done","queue_duration_s":1.092348,"scheduling_latency_s":1.092369,"redis_calls":9,"redis_duration_s":0.0029449999999999997,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001504,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001441,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00084556,"exclusive_lock_hold_duration_s":0.0248383,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.064612,"completed_at":"2026-09-03T10:31:05.601Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.038222,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.773312] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"5c65df0aa12ed3130e519bf6","created_at":"2026-09-03T10:31:04.468Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6d41d49b0f2afbca588e9423c7d93d3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.474Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-5c65df0aa12ed3130e519bf6: start","job_status":"start","queue_duration_s":1.129726,"scheduling_latency_s":1.129748} gitlab # [ 290.786792] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.626Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"5c65df0aa12ed3130e519bf6","created_at":"2026-09-03T10:31:04.468Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6d41d49b0f2afbca588e9423c7d93d3","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.474Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-5c65df0aa12ed3130e519bf6: done: 0.021784 sec","job_status":"done","queue_duration_s":1.129726,"scheduling_latency_s":1.129748,"redis_calls":9,"redis_duration_s":0.002514,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001342,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001172,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00063092,"exclusive_lock_hold_duration_s":0.00407918,"duration_s":0.021784,"completed_at":"2026-09-03T10:31:05.626Z","load_balancing_strategy":"primary","db_duration_s":0.001591,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.825900] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.627Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"029164f3309fbc4acdf4b862","created_at":"2026-09-03T10:31:04.519Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e9d27c72a93b0ffaeab3c494bdef826","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.538Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-029164f3309fbc4acdf4b862: start","job_status":"start","queue_duration_s":1.089375,"scheduling_latency_s":1.089393} gitlab # [ 290.840163] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.636Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 290.843581] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.641Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"029164f3309fbc4acdf4b862","created_at":"2026-09-03T10:31:04.519Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1e9d27c72a93b0ffaeab3c494bdef826","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.538Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-029164f3309fbc4acdf4b862: done: 0.014056 sec","job_status":"done","queue_duration_s":1.089375,"scheduling_latency_s":1.089393,"redis_calls":7,"redis_duration_s":0.001738,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000497,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008622,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014056,"completed_at":"2026-09-03T10:31:05.641Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 290.884443] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"df2cc0fe23a9ae19e06d2f33","created_at":"2026-09-03T10:31:04.593Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5b56ec2817aacc83dad059defd7a188","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.605Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-df2cc0fe23a9ae19e06d2f33: start","job_status":"start","queue_duration_s":1.037471,"scheduling_latency_s":1.037488} gitlab # [ 291.083093] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.953Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"df2cc0fe23a9ae19e06d2f33","created_at":"2026-09-03T10:31:04.593Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f5b56ec2817aacc83dad059defd7a188","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.605Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-df2cc0fe23a9ae19e06d2f33: done: 0.310629 sec","job_status":"done","queue_duration_s":1.037471,"scheduling_latency_s":1.037488,"redis_calls":9,"redis_duration_s":0.002651,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001394,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001257,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.07,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.07,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.210641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00059166,"exclusive_lock_hold_duration_s":0.29356166,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.310629,"completed_at":"2026-09-03T10:31:05.953Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.117701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.170909] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"121a4463ff27560a6b95a5de","created_at":"2026-09-03T10:31:04.650Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"447747626473ab5f30ee34a027b06a00","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.657Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-121a4463ff27560a6b95a5de: start","job_status":"start","queue_duration_s":1.297383,"scheduling_latency_s":1.297401} gitlab # [ 291.191916] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.969Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"121a4463ff27560a6b95a5de","created_at":"2026-09-03T10:31:04.650Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"447747626473ab5f30ee34a027b06a00","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.657Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-121a4463ff27560a6b95a5de: done: 0.014401 sec","job_status":"done","queue_duration_s":1.297383,"scheduling_latency_s":1.297401,"redis_calls":8,"redis_duration_s":0.001219,"redis_read_bytes":133,"redis_write_bytes":841,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000152,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":65,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000337,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014401,"completed_at":"2026-09-03T10:31:05.969Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.237388] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:05.970Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"f52cda9bea40ab70652dc943","created_at":"2026-09-03T10:31:04.709Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.721Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-f52cda9bea40ab70652dc943: start","job_status":"start","queue_duration_s":1.249441,"scheduling_latency_s":1.249457} gitlab # [ 291.250553] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.082Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"f52cda9bea40ab70652dc943","created_at":"2026-09-03T10:31:04.709Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.721Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-f52cda9bea40ab70652dc943: done: 0.111145 sec","job_status":"done","queue_duration_s":1.249441,"scheduling_latency_s":1.249457,"redis_calls":60,"redis_duration_s":0.008219,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000426,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.007412,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000381,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.093336,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.111145,"completed_at":"2026-09-03T10:31:06.082Z","load_balancing_strategy":"primary","db_duration_s":0.011504,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.291636] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.083Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3caf150fd525e1c757146102","created_at":"2026-09-03T10:31:04.817Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25dd2de114f8196f67fa0c8ec736a972","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.833Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3caf150fd525e1c757146102: start","job_status":"start","queue_duration_s":1.250077,"scheduling_latency_s":1.250094} gitlab # [ 291.305976] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.122Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"3caf150fd525e1c757146102","created_at":"2026-09-03T10:31:04.817Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"25dd2de114f8196f67fa0c8ec736a972","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.833Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-3caf150fd525e1c757146102: done: 0.039519 sec","job_status":"done","queue_duration_s":1.250077,"scheduling_latency_s":1.250094,"redis_calls":9,"redis_duration_s":0.001351,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000665,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048842,"exclusive_lock_hold_duration_s":0.02632328,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.039519,"completed_at":"2026-09-03T10:31:06.122Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017809,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.348314] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.124Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e42a9d0d14cccc010aff148d","created_at":"2026-09-03T10:31:04.866Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2628dea9ca346fa4827f5eb28e59935c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.882Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e42a9d0d14cccc010aff148d: start","job_status":"start","queue_duration_s":1.241508,"scheduling_latency_s":1.241524} gitlab # [ 291.362124] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e42a9d0d14cccc010aff148d","created_at":"2026-09-03T10:31:04.866Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2628dea9ca346fa4827f5eb28e59935c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.882Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e42a9d0d14cccc010aff148d: done: 0.015026 sec","job_status":"done","queue_duration_s":1.241508,"scheduling_latency_s":1.241524,"redis_calls":7,"redis_duration_s":0.000986,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000719,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000267,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015026,"completed_at":"2026-09-03T10:31:06.139Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001904,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.401408] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.140Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8073a4cb62ae4e6eb4229ce1","created_at":"2026-09-03T10:31:04.892Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4714767fd6d5fcdef9f8a0b67f2a8ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:31:04.901Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8073a4cb62ae4e6eb4229ce1: start","job_status":"start","queue_duration_s":1.238332,"scheduling_latency_s":1.238349} gitlab # [ 291.414621] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.147Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 291.417949] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.152Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"8073a4cb62ae4e6eb4229ce1","created_at":"2026-09-03T10:31:04.892Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a4714767fd6d5fcdef9f8a0b67f2a8ff","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:31:04.901Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-8073a4cb62ae4e6eb4229ce1: done: 0.01185 sec","job_status":"done","queue_duration_s":1.238332,"scheduling_latency_s":1.238349,"redis_calls":7,"redis_duration_s":0.000941,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000683,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01185,"completed_at":"2026-09-03T10:31:06.152Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.456403] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.153Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"6882b85c67b4ba126943b0b7","created_at":"2026-09-03T10:31:04.922Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"633e1ac1280736eabf588b4fbec8d9dd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.930Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-6882b85c67b4ba126943b0b7: start","job_status":"start","queue_duration_s":1.222435,"scheduling_latency_s":1.22245} gitlab # [ 291.470992] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.173Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"6882b85c67b4ba126943b0b7","created_at":"2026-09-03T10:31:04.922Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"633e1ac1280736eabf588b4fbec8d9dd","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.930Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-6882b85c67b4ba126943b0b7: done: 0.020644 sec","job_status":"done","queue_duration_s":1.222435,"scheduling_latency_s":1.22245,"redis_calls":7,"redis_duration_s":0.001,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000715,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000285,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020644,"completed_at":"2026-09-03T10:31:06.173Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.510421] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.175Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"92019d595cd54e777332800b","created_at":"2026-09-03T10:31:04.942Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58c94c8463be88c7eb2d044f5f4c5cd8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.947Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-92019d595cd54e777332800b: start","job_status":"start","queue_duration_s":1.227386,"scheduling_latency_s":1.227403} gitlab # [ 291.524146] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.202Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"92019d595cd54e777332800b","created_at":"2026-09-03T10:31:04.942Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58c94c8463be88c7eb2d044f5f4c5cd8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:04.947Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-92019d595cd54e777332800b: done: 0.027611 sec","job_status":"done","queue_duration_s":1.227386,"scheduling_latency_s":1.227403,"redis_calls":7,"redis_duration_s":0.000965,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000268,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.027611,"completed_at":"2026-09-03T10:31:06.202Z","load_balancing_strategy":"primary","db_duration_s":0.014476,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.564139] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ae59ab7e1e4641493339f9b3","created_at":"2026-09-03T10:31:04.995Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61bdcf3c0f3345007a9a2a7410ae7499","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:05.011Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ae59ab7e1e4641493339f9b3: start","job_status":"start","queue_duration_s":1.192048,"scheduling_latency_s":1.192066} gitlab # [ 291.578385] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.226Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ae59ab7e1e4641493339f9b3","created_at":"2026-09-03T10:31:04.995Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61bdcf3c0f3345007a9a2a7410ae7499","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:05.011Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ae59ab7e1e4641493339f9b3: done: 0.022393 sec","job_status":"done","queue_duration_s":1.192048,"scheduling_latency_s":1.192066,"redis_calls":10,"redis_duration_s":0.001532,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000597,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0077997,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.022393,"completed_at":"2026-09-03T10:31:06.226Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005565,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 291.620141] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.227Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0f101d356d92a7b9e675ec41","created_at":"2026-09-03T10:31:05.036Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8708409ece6814f5889896081f8d9b3f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:31:05.042Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0f101d356d92a7b9e675ec41: start","job_status":"start","queue_duration_s":1.184504,"scheduling_latency_s":1.184521} gitlab # [ 291.632717] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.247Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0f101d356d92a7b9e675ec41","created_at":"2026-09-03T10:31:05.036Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8708409ece6814f5889896081f8d9b3f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:31:05.042Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0f101d356d92a7b9e675ec41: done: 0.019995 sec","job_status":"done","queue_duration_s":1.184504,"scheduling_latency_s":1.184521,"redis_calls":7,"redis_duration_s":0.000994,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000718,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000276,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013311,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019995,"completed_at":"2026-09-03T10:31:06.247Z","load_balancing_strategy":"primary","db_duration_s":0.002658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.671173] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"8006a1f1b25e321856c42018","created_at":"2026-09-03T10:31:05.056Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"933d4fb8855cd99c6e81bf7991218112","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:05.065Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-8006a1f1b25e321856c42018: start","job_status":"start","queue_duration_s":1.182975,"scheduling_latency_s":1.182991} gitlab # [ 291.686296] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"8006a1f1b25e321856c42018","created_at":"2026-09-03T10:31:05.056Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-fde5d929022744eb","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"933d4fb8855cd99c6e81bf7991218112","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:05.065Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-8006a1f1b25e321856c42018: done: 0.015663 sec","job_status":"done","queue_duration_s":1.182975,"scheduling_latency_s":1.182991,"redis_calls":9,"redis_duration_s":0.001254,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000673,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000581,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00046642,"exclusive_lock_hold_duration_s":0.00324034,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.015663,"completed_at":"2026-09-03T10:31:06.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001642,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.726899] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"774325b52f58f7f24f4d2bd7","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-774325b52f58f7f24f4d2bd7: start","job_status":"start","queue_duration_s":0.189266,"scheduling_latency_s":0.189283} gitlab # [ 291.739183] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"774325b52f58f7f24f4d2bd7","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-774325b52f58f7f24f4d2bd7: done: 0.014394 sec","job_status":"done","queue_duration_s":0.189266,"scheduling_latency_s":0.189283,"redis_calls":13,"redis_duration_s":0.001575,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001046,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014394,"completed_at":"2026-09-03T10:31:06.279Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.777546] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c9fe9732f3dc1fa02f2fcae","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c9fe9732f3dc1fa02f2fcae: start","job_status":"start","queue_duration_s":0.204739,"scheduling_latency_s":0.204756} gitlab # [ 291.789611] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c9fe9732f3dc1fa02f2fcae","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c9fe9732f3dc1fa02f2fcae: done: 0.013682 sec","job_status":"done","queue_duration_s":0.204739,"scheduling_latency_s":0.204756,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013682,"completed_at":"2026-09-03T10:31:06.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.828245] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfecd395136b99623b3ac8fa","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfecd395136b99623b3ac8fa: start","job_status":"start","queue_duration_s":0.219533,"scheduling_latency_s":0.219549} gitlab # [ 291.840178] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfecd395136b99623b3ac8fa","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfecd395136b99623b3ac8fa: done: 0.013798 sec","job_status":"done","queue_duration_s":0.219533,"scheduling_latency_s":0.219549,"redis_calls":13,"redis_duration_s":0.001486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009552,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013798,"completed_at":"2026-09-03T10:31:06.309Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.879390] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6cc5ab32586868b3cf6ee24","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6cc5ab32586868b3cf6ee24: start","job_status":"start","queue_duration_s":0.234496,"scheduling_latency_s":0.234512} gitlab # [ 291.891683] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6cc5ab32586868b3cf6ee24","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6cc5ab32586868b3cf6ee24: done: 0.013699 sec","job_status":"done","queue_duration_s":0.234496,"scheduling_latency_s":0.234512,"redis_calls":13,"redis_duration_s":0.001417,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013699,"completed_at":"2026-09-03T10:31:06.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.930471] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc2d959a0bb62b1234b6eb4c","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc2d959a0bb62b1234b6eb4c: start","job_status":"start","queue_duration_s":0.249265,"scheduling_latency_s":0.249281} gitlab # [ 291.942859] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc2d959a0bb62b1234b6eb4c","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc2d959a0bb62b1234b6eb4c: done: 0.013633 sec","job_status":"done","queue_duration_s":0.249265,"scheduling_latency_s":0.249281,"redis_calls":13,"redis_duration_s":0.001428,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009422,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013633,"completed_at":"2026-09-03T10:31:06.339Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 291.981313] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3963042bbe8550a04075a93f","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3963042bbe8550a04075a93f: start","job_status":"start","queue_duration_s":0.264003,"scheduling_latency_s":0.264019} gitlab # [ 291.993539] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3963042bbe8550a04075a93f","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3963042bbe8550a04075a93f: done: 0.013816 sec","job_status":"done","queue_duration_s":0.264003,"scheduling_latency_s":0.264019,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013816,"completed_at":"2026-09-03T10:31:06.353Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.032548] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25cb29ed1719e71eab039c18","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25cb29ed1719e71eab039c18: start","job_status":"start","queue_duration_s":0.279068,"scheduling_latency_s":0.279085} gitlab # [ 292.044673] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25cb29ed1719e71eab039c18","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25cb29ed1719e71eab039c18: done: 0.013959 sec","job_status":"done","queue_duration_s":0.279068,"scheduling_latency_s":0.279085,"redis_calls":13,"redis_duration_s":0.001611,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013959,"completed_at":"2026-09-03T10:31:06.369Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.084419] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb36080de03ae0563d5777a5","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb36080de03ae0563d5777a5: start","job_status":"start","queue_duration_s":0.294128,"scheduling_latency_s":0.294144} gitlab # [ 292.096643] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb36080de03ae0563d5777a5","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb36080de03ae0563d5777a5: done: 0.013668 sec","job_status":"done","queue_duration_s":0.294128,"scheduling_latency_s":0.294144,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013668,"completed_at":"2026-09-03T10:31:06.383Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.135505] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"990ed1e7300ab2cacc728993","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-990ed1e7300ab2cacc728993: start","job_status":"start","queue_duration_s":0.308907,"scheduling_latency_s":0.308924} gitlab # [ 292.148187] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.398Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"990ed1e7300ab2cacc728993","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-990ed1e7300ab2cacc728993: done: 0.013737 sec","job_status":"done","queue_duration_s":0.308907,"scheduling_latency_s":0.308924,"redis_calls":13,"redis_duration_s":0.001438,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013737,"completed_at":"2026-09-03T10:31:06.398Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.187277] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b08d7c531d7306009d428e4","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b08d7c531d7306009d428e4: start","job_status":"start","queue_duration_s":0.323761,"scheduling_latency_s":0.323777} gitlab # [ 292.199665] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.413Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2b08d7c531d7306009d428e4","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2b08d7c531d7306009d428e4: done: 0.013449 sec","job_status":"done","queue_duration_s":0.323761,"scheduling_latency_s":0.323777,"redis_calls":13,"redis_duration_s":0.001373,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000496,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000877,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013449,"completed_at":"2026-09-03T10:31:06.413Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.238380] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.414Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a30e01f4175bc08c5c193dfb","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a30e01f4175bc08c5c193dfb: start","job_status":"start","queue_duration_s":0.338316,"scheduling_latency_s":0.338332} gitlab # [ 292.250852] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a30e01f4175bc08c5c193dfb","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a30e01f4175bc08c5c193dfb: done: 0.013669 sec","job_status":"done","queue_duration_s":0.338316,"scheduling_latency_s":0.338332,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013669,"completed_at":"2026-09-03T10:31:06.428Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.290580] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba1131ff977734b2053842f4","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba1131ff977734b2053842f4: start","job_status":"start","queue_duration_s":0.353059,"scheduling_latency_s":0.353075} gitlab # [ 292.302841] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ba1131ff977734b2053842f4","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ba1131ff977734b2053842f4: done: 0.013603 sec","job_status":"done","queue_duration_s":0.353059,"scheduling_latency_s":0.353075,"redis_calls":13,"redis_duration_s":0.0013809999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013603,"completed_at":"2026-09-03T10:31:06.442Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.341624] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b62b8bd08976d014041ab281","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b62b8bd08976d014041ab281: start","job_status":"start","queue_duration_s":0.367766,"scheduling_latency_s":0.367782} gitlab # [ 292.354294] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b62b8bd08976d014041ab281","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b62b8bd08976d014041ab281: done: 0.013465 sec","job_status":"done","queue_duration_s":0.367766,"scheduling_latency_s":0.367782,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013465,"completed_at":"2026-09-03T10:31:06.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.392809] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.458Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75e920f03a0c28b77914d881","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75e920f03a0c28b77914d881: start","job_status":"start","queue_duration_s":0.382333,"scheduling_latency_s":0.38235} gitlab # [ 292.405230] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75e920f03a0c28b77914d881","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75e920f03a0c28b77914d881: done: 0.014001 sec","job_status":"done","queue_duration_s":0.382333,"scheduling_latency_s":0.38235,"redis_calls":13,"redis_duration_s":0.001614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001083,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014001,"completed_at":"2026-09-03T10:31:06.472Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.443326] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87d2fa93442277022388da92","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87d2fa93442277022388da92: start","job_status":"start","queue_duration_s":0.39742,"scheduling_latency_s":0.397436} gitlab # [ 292.455490] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87d2fa93442277022388da92","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87d2fa93442277022388da92: done: 0.013686 sec","job_status":"done","queue_duration_s":0.39742,"scheduling_latency_s":0.397436,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013686,"completed_at":"2026-09-03T10:31:06.487Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.494845] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"125875f70951dade6dda9f06","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-125875f70951dade6dda9f06: start","job_status":"start","queue_duration_s":0.412182,"scheduling_latency_s":0.412198} gitlab # [ 292.507109] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.501Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"125875f70951dade6dda9f06","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-125875f70951dade6dda9f06: done: 0.013462 sec","job_status":"done","queue_duration_s":0.412182,"scheduling_latency_s":0.412198,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013462,"completed_at":"2026-09-03T10:31:06.501Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.545218] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.502Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"300ab420315bde6e991c918f","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-300ab420315bde6e991c918f: start","job_status":"start","queue_duration_s":0.426706,"scheduling_latency_s":0.426722} gitlab # [ 292.557210] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"300ab420315bde6e991c918f","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-300ab420315bde6e991c918f: done: 0.013792 sec","job_status":"done","queue_duration_s":0.426706,"scheduling_latency_s":0.426722,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013792,"completed_at":"2026-09-03T10:31:06.516Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.595315] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"429ef22771ede6375db141e4","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-429ef22771ede6375db141e4: start","job_status":"start","queue_duration_s":0.441561,"scheduling_latency_s":0.441578} gitlab # [ 292.607619] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"429ef22771ede6375db141e4","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-429ef22771ede6375db141e4: done: 0.013572 sec","job_status":"done","queue_duration_s":0.441561,"scheduling_latency_s":0.441578,"redis_calls":13,"redis_duration_s":0.001406,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013572,"completed_at":"2026-09-03T10:31:06.531Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.645675] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14b78edb13c8e8b6803a34d8","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14b78edb13c8e8b6803a34d8: start","job_status":"start","queue_duration_s":0.456231,"scheduling_latency_s":0.456248} gitlab # [ 292.657716] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.545Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14b78edb13c8e8b6803a34d8","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14b78edb13c8e8b6803a34d8: done: 0.01353 sec","job_status":"done","queue_duration_s":0.456231,"scheduling_latency_s":0.456248,"redis_calls":13,"redis_duration_s":0.00142,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01353,"completed_at":"2026-09-03T10:31:06.545Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.696759] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d2a95f1cc9415043788eb74","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d2a95f1cc9415043788eb74: start","job_status":"start","queue_duration_s":0.470921,"scheduling_latency_s":0.470939} gitlab # [ 292.708939] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d2a95f1cc9415043788eb74","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d2a95f1cc9415043788eb74: done: 0.013713 sec","job_status":"done","queue_duration_s":0.470921,"scheduling_latency_s":0.470939,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009495,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013713,"completed_at":"2026-09-03T10:31:06.560Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.747826] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.561Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dcf9f0204406fe4ab268b9d","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dcf9f0204406fe4ab268b9d: start","job_status":"start","queue_duration_s":0.485722,"scheduling_latency_s":0.485738} gitlab # [ 292.759989] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1dcf9f0204406fe4ab268b9d","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1dcf9f0204406fe4ab268b9d: done: 0.013799 sec","job_status":"done","queue_duration_s":0.485722,"scheduling_latency_s":0.485738,"redis_calls":13,"redis_duration_s":0.001582,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009413,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013799,"completed_at":"2026-09-03T10:31:06.575Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.798089] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b65274bdec190ae57224dd9","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b65274bdec190ae57224dd9: start","job_status":"start","queue_duration_s":0.500577,"scheduling_latency_s":0.500593} gitlab # [ 292.810141] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b65274bdec190ae57224dd9","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b65274bdec190ae57224dd9: done: 0.013707 sec","job_status":"done","queue_duration_s":0.500577,"scheduling_latency_s":0.500593,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013707,"completed_at":"2026-09-03T10:31:06.590Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.848539] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d03947b335629510d3db9bf","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d03947b335629510d3db9bf: start","job_status":"start","queue_duration_s":0.515379,"scheduling_latency_s":0.515423} gitlab # [ 292.860522] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d03947b335629510d3db9bf","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d03947b335629510d3db9bf: done: 0.013687 sec","job_status":"done","queue_duration_s":0.515379,"scheduling_latency_s":0.515423,"redis_calls":13,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013687,"completed_at":"2026-09-03T10:31:06.605Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.899495] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd6e2169bb6e73af890dffa8","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd6e2169bb6e73af890dffa8: start","job_status":"start","queue_duration_s":0.530185,"scheduling_latency_s":0.530202} gitlab # [ 292.911785] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd6e2169bb6e73af890dffa8","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd6e2169bb6e73af890dffa8: done: 0.013549 sec","job_status":"done","queue_duration_s":0.530185,"scheduling_latency_s":0.530202,"redis_calls":13,"redis_duration_s":0.0013839999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000881,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013549,"completed_at":"2026-09-03T10:31:06.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 292.950009] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c54acd75051c2be00eeb717c","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c54acd75051c2be00eeb717c: start","job_status":"start","queue_duration_s":0.54482,"scheduling_latency_s":0.544836} gitlab # [ 292.962263] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.634Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c54acd75051c2be00eeb717c","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c54acd75051c2be00eeb717c: done: 0.013731 sec","job_status":"done","queue_duration_s":0.54482,"scheduling_latency_s":0.544836,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013731,"completed_at":"2026-09-03T10:31:06.634Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.000225] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65d2197d080204cebdfc2ab8","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65d2197d080204cebdfc2ab8: start","job_status":"start","queue_duration_s":0.559657,"scheduling_latency_s":0.559673} gitlab # [ 293.012229] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.649Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65d2197d080204cebdfc2ab8","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65d2197d080204cebdfc2ab8: done: 0.013602 sec","job_status":"done","queue_duration_s":0.559657,"scheduling_latency_s":0.559673,"redis_calls":13,"redis_duration_s":0.00141,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013602,"completed_at":"2026-09-03T10:31:06.649Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.050329] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.650Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87fcd4c3fa1d17797f797280","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87fcd4c3fa1d17797f797280: start","job_status":"start","queue_duration_s":0.574355,"scheduling_latency_s":0.57437} gitlab # [ 293.062292] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87fcd4c3fa1d17797f797280","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87fcd4c3fa1d17797f797280: done: 0.013554 sec","job_status":"done","queue_duration_s":0.574355,"scheduling_latency_s":0.57437,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013554,"completed_at":"2026-09-03T10:31:06.664Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.100163] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.665Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e53c1a910caef9d9c882616c","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e53c1a910caef9d9c882616c: start","job_status":"start","queue_duration_s":0.588986,"scheduling_latency_s":0.589002} gitlab # [ 293.113279] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e53c1a910caef9d9c882616c","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e53c1a910caef9d9c882616c: done: 0.013957 sec","job_status":"done","queue_duration_s":0.588986,"scheduling_latency_s":0.589002,"redis_calls":13,"redis_duration_s":0.001443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013957,"completed_at":"2026-09-03T10:31:06.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.151368] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf66c36f0e06d83477940a91","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf66c36f0e06d83477940a91: start","job_status":"start","queue_duration_s":0.604055,"scheduling_latency_s":0.604071} gitlab # [ 293.163550] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf66c36f0e06d83477940a91","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf66c36f0e06d83477940a91: done: 0.013626 sec","job_status":"done","queue_duration_s":0.604055,"scheduling_latency_s":0.604071,"redis_calls":13,"redis_duration_s":0.001465,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013626,"completed_at":"2026-09-03T10:31:06.693Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.201976] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6629cc5669345f6dc504e19","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6629cc5669345f6dc504e19: start","job_status":"start","queue_duration_s":0.61879,"scheduling_latency_s":0.618806} gitlab # [ 293.214283] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c6629cc5669345f6dc504e19","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c6629cc5669345f6dc504e19: done: 0.013516 sec","job_status":"done","queue_duration_s":0.61879,"scheduling_latency_s":0.618806,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013516,"completed_at":"2026-09-03T10:31:06.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.252578] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35b4af77deb5ed09e806f787","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35b4af77deb5ed09e806f787: start","job_status":"start","queue_duration_s":0.633382,"scheduling_latency_s":0.633399} gitlab # [ 293.264428] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.723Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35b4af77deb5ed09e806f787","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35b4af77deb5ed09e806f787: done: 0.013717 sec","job_status":"done","queue_duration_s":0.633382,"scheduling_latency_s":0.633399,"redis_calls":13,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009484,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013717,"completed_at":"2026-09-03T10:31:06.723Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.302561] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd889020bd894f914722efe3","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd889020bd894f914722efe3: start","job_status":"start","queue_duration_s":0.648212,"scheduling_latency_s":0.648229} gitlab # [ 293.315734] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd889020bd894f914722efe3","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd889020bd894f914722efe3: done: 0.013639 sec","job_status":"done","queue_duration_s":0.648212,"scheduling_latency_s":0.648229,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013639,"completed_at":"2026-09-03T10:31:06.738Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.353834] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51be517ce3291eccb103a262","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51be517ce3291eccb103a262: start","job_status":"start","queue_duration_s":0.662915,"scheduling_latency_s":0.662932} gitlab # [ 293.366768] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51be517ce3291eccb103a262","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51be517ce3291eccb103a262: done: 0.013589 sec","job_status":"done","queue_duration_s":0.662915,"scheduling_latency_s":0.662932,"redis_calls":13,"redis_duration_s":0.0013969999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013589,"completed_at":"2026-09-03T10:31:06.752Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.405505] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1435d17306fc2fcaacbac32a","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1435d17306fc2fcaacbac32a: start","job_status":"start","queue_duration_s":0.677567,"scheduling_latency_s":0.677583} gitlab # [ 293.417797] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1435d17306fc2fcaacbac32a","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1435d17306fc2fcaacbac32a: done: 0.014014 sec","job_status":"done","queue_duration_s":0.677567,"scheduling_latency_s":0.677583,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014014,"completed_at":"2026-09-03T10:31:06.767Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.456182] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"592d04a87b7ee1cc86fb5a89","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-592d04a87b7ee1cc86fb5a89: start","job_status":"start","queue_duration_s":0.692672,"scheduling_latency_s":0.692687} gitlab # [ 293.468260] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"592d04a87b7ee1cc86fb5a89","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-592d04a87b7ee1cc86fb5a89: done: 0.013602 sec","job_status":"done","queue_duration_s":0.692672,"scheduling_latency_s":0.692687,"redis_calls":13,"redis_duration_s":0.00142,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013602,"completed_at":"2026-09-03T10:31:06.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.506719] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30c97fa7a813f06e63909ad3","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30c97fa7a813f06e63909ad3: start","job_status":"start","queue_duration_s":0.707341,"scheduling_latency_s":0.707357} gitlab # [ 293.519765] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30c97fa7a813f06e63909ad3","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30c97fa7a813f06e63909ad3: done: 0.013541 sec","job_status":"done","queue_duration_s":0.707341,"scheduling_latency_s":0.707357,"redis_calls":13,"redis_duration_s":0.0014260000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013541,"completed_at":"2026-09-03T10:31:06.797Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.558504] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db0ad6031c65d2248d4b218a","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db0ad6031c65d2248d4b218a: start","job_status":"start","queue_duration_s":0.722004,"scheduling_latency_s":0.72202} gitlab # [ 293.570750] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db0ad6031c65d2248d4b218a","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db0ad6031c65d2248d4b218a: done: 0.014036 sec","job_status":"done","queue_duration_s":0.722004,"scheduling_latency_s":0.72202,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014036,"completed_at":"2026-09-03T10:31:06.812Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.609066] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37e365ab9af6c98155462a5e","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37e365ab9af6c98155462a5e: start","job_status":"start","queue_duration_s":0.737097,"scheduling_latency_s":0.737113} gitlab # [ 293.621268] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37e365ab9af6c98155462a5e","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37e365ab9af6c98155462a5e: done: 0.013555 sec","job_status":"done","queue_duration_s":0.737097,"scheduling_latency_s":0.737113,"redis_calls":13,"redis_duration_s":0.001387,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013555,"completed_at":"2026-09-03T10:31:06.826Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.660132] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7a8d97396729eb53425a858","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7a8d97396729eb53425a858: start","job_status":"start","queue_duration_s":0.751729,"scheduling_latency_s":0.751745} gitlab # [ 293.672072] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a7a8d97396729eb53425a858","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a7a8d97396729eb53425a858: done: 0.01359 sec","job_status":"done","queue_duration_s":0.751729,"scheduling_latency_s":0.751745,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01359,"completed_at":"2026-09-03T10:31:06.841Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.710549] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"274b72c08592613d71035317","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-274b72c08592613d71035317: start","job_status":"start","queue_duration_s":0.766449,"scheduling_latency_s":0.766466} gitlab # [ 293.723803] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"274b72c08592613d71035317","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-274b72c08592613d71035317: done: 0.013635 sec","job_status":"done","queue_duration_s":0.766449,"scheduling_latency_s":0.766466,"redis_calls":13,"redis_duration_s":0.001426,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013635,"completed_at":"2026-09-03T10:31:06.856Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.762748] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f24c1ee9f043da686b69767","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f24c1ee9f043da686b69767: start","job_status":"start","queue_duration_s":0.781164,"scheduling_latency_s":0.78118} gitlab # [ 293.775023] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f24c1ee9f043da686b69767","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f24c1ee9f043da686b69767: done: 0.013851 sec","job_status":"done","queue_duration_s":0.781164,"scheduling_latency_s":0.78118,"redis_calls":13,"redis_duration_s":0.001601,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013851,"completed_at":"2026-09-03T10:31:06.871Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.813455] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eff97ed3e3e5d19503842f60","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eff97ed3e3e5d19503842f60: start","job_status":"start","queue_duration_s":0.796117,"scheduling_latency_s":0.796133} gitlab # [ 293.825443] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eff97ed3e3e5d19503842f60","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eff97ed3e3e5d19503842f60: done: 0.013684 sec","job_status":"done","queue_duration_s":0.796117,"scheduling_latency_s":0.796133,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013684,"completed_at":"2026-09-03T10:31:06.885Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.863821] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a98a98490900e385b073681f","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a98a98490900e385b073681f: start","job_status":"start","queue_duration_s":0.810965,"scheduling_latency_s":0.810981} gitlab # [ 293.876061] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a98a98490900e385b073681f","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a98a98490900e385b073681f: done: 0.013698 sec","job_status":"done","queue_duration_s":0.810965,"scheduling_latency_s":0.810981,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013698,"completed_at":"2026-09-03T10:31:06.900Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.913926] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"305938248a4190ed66a1daa9","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-305938248a4190ed66a1daa9: start","job_status":"start","queue_duration_s":0.825744,"scheduling_latency_s":0.825761} gitlab # [ 293.927252] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"305938248a4190ed66a1daa9","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-305938248a4190ed66a1daa9: done: 0.013566 sec","job_status":"done","queue_duration_s":0.825744,"scheduling_latency_s":0.825761,"redis_calls":13,"redis_duration_s":0.0013830000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000875,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013566,"completed_at":"2026-09-03T10:31:06.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 293.965592] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b421b9f430aaaa040d1e237a","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b421b9f430aaaa040d1e237a: start","job_status":"start","queue_duration_s":0.840446,"scheduling_latency_s":0.840463} gitlab # [ 293.977546] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b421b9f430aaaa040d1e237a","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b421b9f430aaaa040d1e237a: done: 0.02984 sec","job_status":"done","queue_duration_s":0.840446,"scheduling_latency_s":0.840463,"redis_calls":13,"redis_duration_s":0.0014329999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02984,"completed_at":"2026-09-03T10:31:06.946Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.016150] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5414115606d6ca7d9733a905","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5414115606d6ca7d9733a905: start","job_status":"start","queue_duration_s":0.872309,"scheduling_latency_s":0.872324} gitlab # [ 294.028293] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5414115606d6ca7d9733a905","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5414115606d6ca7d9733a905: done: 0.014747 sec","job_status":"done","queue_duration_s":0.872309,"scheduling_latency_s":0.872324,"redis_calls":13,"redis_duration_s":0.001492,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000598,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010506,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014747,"completed_at":"2026-09-03T10:31:06.963Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.066538] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e78ddadf0088cdfe44970bd","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e78ddadf0088cdfe44970bd: start","job_status":"start","queue_duration_s":0.888174,"scheduling_latency_s":0.88819} gitlab # [ 294.078618] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4e78ddadf0088cdfe44970bd","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4e78ddadf0088cdfe44970bd: done: 0.014968 sec","job_status":"done","queue_duration_s":0.888174,"scheduling_latency_s":0.88819,"redis_calls":13,"redis_duration_s":0.001591,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001073,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014968,"completed_at":"2026-09-03T10:31:06.979Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.116980] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.980Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7544b1e893e95477342150e","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7544b1e893e95477342150e: start","job_status":"start","queue_duration_s":0.904315,"scheduling_latency_s":0.904331} gitlab # [ 294.129935] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7544b1e893e95477342150e","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7544b1e893e95477342150e: done: 0.014392 sec","job_status":"done","queue_duration_s":0.904315,"scheduling_latency_s":0.904331,"redis_calls":13,"redis_duration_s":0.001411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014392,"completed_at":"2026-09-03T10:31:06.994Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.167878] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:06.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c2f66259a0a3c4382136e6b","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c2f66259a0a3c4382136e6b: start","job_status":"start","queue_duration_s":0.920834,"scheduling_latency_s":0.920848} gitlab # [ 294.180244] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:07.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c2f66259a0a3c4382136e6b","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c2f66259a0a3c4382136e6b: done: 0.014585 sec","job_status":"done","queue_duration_s":0.920834,"scheduling_latency_s":0.920848,"redis_calls":13,"redis_duration_s":0.002263,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001375,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014585,"completed_at":"2026-09-03T10:31:07.011Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 294.218359] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:07.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42f19dab9efe028ce2d55a66","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42f19dab9efe028ce2d55a66: start","job_status":"start","queue_duration_s":0.936559,"scheduling_latency_s":0.936576} gitlab # [ 294.230325] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:07.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42f19dab9efe028ce2d55a66","created_at":"2026-09-03T10:31:05.979Z","trace_propagation_headers":{"sentry-trace":"b3a4ecf61b2244fba456e541dc18230d-cdcf43efccbb4d8f","baggage":"sentry-trace_id=b3a4ecf61b2244fba456e541dc18230d,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"c54503a1d252a1bd61e8218d998508b6","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:06.076Z","job_size_bytes":2,"pid":1986,"sidekiq_tid":"map6","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42f19dab9efe028ce2d55a66: done: 0.015959 sec","job_status":"done","queue_duration_s":0.936559,"scheduling_latency_s":0.936576,"redis_calls":13,"redis_duration_s":0.00163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000626,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015959,"completed_at":"2026-09-03T10:31:07.028Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 305.103634] postgres[3236]: [3236] ERROR: relation "table_without_models" does not exist gitlab # [ 305.104741] postgres[3236]: [3236] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 309.228763] redis[790]: 10 changes in 300 seconds. Saving... gitlab # [ 309.234700] redis[790]: Background saving started by pid 3275 gitlab # [ 309.241465] redis[3275]: BGSAVE done, 536 keys saved, 0 keys skipped, 132642 bytes written. gitlab # [ 309.245956] redis[3275]: DB saved on disk gitlab # [ 309.248207] redis[3275]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB gitlab # [ 309.329954] redis[790]: Background saving terminated with success gitlab # [ 310.657580] runuser[2911]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 310.658612] setup-gitlab-start[2881]: + systemctl restart gitlab-sidekiq.service gitlab # [ 310.702530] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 310.708585] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:25.573Z","message":"Shutting down"} gitlab # [ 310.712758] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:25.573Z","message":"Scheduler exiting..."} gitlab # [ 310.716979] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:25.574Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 310.722089] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:25.574Z","message":"Scheduler exiting..."} gitlab # [ 311.152654] postgres[860]: [860] LOG: checkpoint starting: time gitlab # [ 311.204659] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:26.075Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 312.268581] gitaly[920]: time="2026-09-03T10:31:27.138Z" level=info msg="burden monitor stats" pid=920 gitlab # [ 312.708671] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:27.578Z","message":"Bye!"} gitlab # [ 312.749694] sidekiq-cluster[1986]: {"severity":"INFO","time":"2026-09-03T10:31:27.620Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":1986,"worker_id":"sidekiq_0","memwd_rss_bytes":919330816,"retry":0} gitlab # [ 314.439396] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 314.439829] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 314.440144] systemd[1]: gitlab-sidekiq.service: Consumed 1min 47.404s CPU time over 3min 15.329s wall clock time, 935.6M memory peak, 4.5M read from disk. gitlab # [ 314.453697] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 314.458373] setup-gitlab-start[2881]: + mkdir -p /var/lib/secrets gitlab # [ 314.464229] setup-gitlab-start[2881]: + echo nixbot-test-token-of-20-chars gitlab # [ 314.467230] setup-gitlab-start[2881]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 314.470373] setup-gitlab-start[2881]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 315.661221] gitaly[920]: time="2026-09-03T10:31:30.531Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:31:40.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:30.531" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 315.664521] gitaly[920]: time="2026-09-03T10:31:30.532Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:31:40.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:30.531" grpc.time_ms=0.691 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 315.910596] gitaly[920]: time="2026-09-03T10:31:30.781Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:31:40.260" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:30.781" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 315.971774] gitaly[920]: time="2026-09-03T10:31:30.782Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:31:40.260" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:30.781" grpc.time_ms=0.571 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 315.999679] gitaly[920]: time="2026-09-03T10:31:30.861Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN diskcache=869ec0b1-0e78-4715-bf13-38fed2973d3f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-03T10:31:40.275" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:30.796" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 316.023409] gitaly[920]: time="2026-09-03T10:31:30.861Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=37 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1438 command.oublock=32 command.real_time_ms=43 command.spawn_token_fork_ms=7 command.system_time_ms=34 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-03T10:31:40.275" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:30.796" grpc.time_ms=65.465 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 316.046221] gitaly[920]: time="2026-09-03T10:31:30.882Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:31:40.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:30.880" pid=920 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 316.062189] gitaly[920]: time="2026-09-03T10:31:30.882Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:31:40.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:30.880" grpc.time_ms=1.666 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 316.077944] gitaly[920]: time="2026-09-03T10:31:30.905Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:31:40.019" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:30.890" grpc.time_ms=14.707 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 316.130778] gitaly[920]: time="2026-09-03T10:31:31.002Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:31:40.130" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:31.001" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 316.152646] gitaly[920]: time="2026-09-03T10:31:31.002Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:31:40.130" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:31.001" grpc.time_ms=0.679 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 316.183600] gitaly[920]: time="2026-09-03T10:31:31.054Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN diskcache=55c2e7dd-c697-4af0-996c-ebf104aa8410 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-03T10:31:41.005" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:31.006" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 316.215187] gitaly[920]: time="2026-09-03T10:31:31.055Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=30 command.spawn_token_fork_ms=3 command.system_time_ms=11 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-03T10:31:41.005" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:31.006" grpc.time_ms=48.935 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 316.247548] gitaly[920]: time="2026-09-03T10:31:31.062Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:31:41.061" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:31.061" pid=920 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 316.268711] gitaly[920]: time="2026-09-03T10:31:31.062Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:31:41.061" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:31.061" grpc.time_ms=0.699 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 316.287969] gitaly[920]: time="2026-09-03T10:31:31.076Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:31:41.065" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:31.066" grpc.time_ms=9.886 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 316.309553] gitaly[920]: time="2026-09-03T10:31:31.113Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:31:41.113" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:31.113" grpc.time_ms=0.162 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 316.324181] gitaly[920]: time="2026-09-03T10:31:31.125Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-03T10:31:41.124" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:31.125" grpc.time_ms=0.495 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 316.849597] gitaly[920]: time="2026-09-03T10:31:31.719Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5PAQ4DW1A1C86PVVAQBN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:31:41.181" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:31.701" grpc.time_ms=17.68 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 317.445041] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:32 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 2947 gitlab # [ 317.451615] setup-gitlab-start[2881]: + mkdir -p /tmp/test-flake gitlab # [ 317.454481] setup-gitlab-start[2881]: + cd /tmp/test-flake gitlab # [ 317.456767] setup-gitlab-start[2881]: + git init -b master gitlab # [ 317.478787] setup-gitlab-start[3352]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 317.482513] setup-gitlab-start[2881]: + git config user.name test gitlab # [ 317.486093] setup-gitlab-start[2881]: + git config user.email test@example.com gitlab # [ 317.493101] setup-gitlab-start[2881]: + cat gitlab # [ 317.498634] setup-gitlab-start[2881]: + git add flake.nix gitlab # [ 317.507711] setup-gitlab-start[2881]: + git commit -m 'initial commit' gitlab # [ 317.534670] setup-gitlab-start[3357]: [master (root-commit) 9e55eca] initial commit gitlab # [ 317.537721] setup-gitlab-start[3357]: 1 file changed, 10 insertions(+) gitlab # [ 317.540165] setup-gitlab-start[3357]: create mode 100644 flake.nix gitlab # [ 317.542555] setup-gitlab-start[2881]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 317.547755] setup-gitlab-start[2881]: + git push -u origin master gitlab # [ 317.666674] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:32 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 75 gitlab # [ 317.842242] gitaly[920]: time="2026-09-03T10:31:32.713Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SDVFRY23VEXRP7NDXTG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:32.694" grpc.time_ms=18.401 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 317.881645] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:32 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 174 gitlab # [ 319.177424] gitaly[920]: time="2026-09-03T10:31:34.047Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:31:44.000" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:34.031" grpc.time_ms=16.256 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.250251] gitaly[920]: time="2026-09-03T10:31:34.121Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-03T10:32:04.002" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-03T10:31:34.103" grpc.time_ms=18.106 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.301462] gitaly[920]: time="2026-09-03T10:31:34.172Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE duration_ms=311ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 319.369442] gitaly[920]: time="2026-09-03T10:31:34.240Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE duration_ms=66ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 319.381558] gitaly[920]: time="2026-09-03T10:31:34.240Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:31:33.860" grpc.time_ms=380.394 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 319.410690] sidekiq-cluster[3301]: {"severity":"INFO","time":"2026-09-03T10:31:34.242Z","message":"Starting cluster with 1 processes"} gitlab # [ 319.430465] gitaly[920]: time="2026-09-03T10:31:34.301Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:31:34.300" grpc.time_ms=1.148 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 319.510731] gitaly[920]: time="2026-09-03T10:31:34.382Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:31:34.379" grpc.time_ms=2.161 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 319.565145] gitaly[920]: time="2026-09-03T10:31:34.436Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:31:34.434" grpc.time_ms=1.41 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 319.705765] gitaly[920]: time="2026-09-03T10:31:34.576Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:31:44.040" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:34.560" grpc.time_ms=16.195 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.798494] gitaly[920]: time="2026-09-03T10:31:34.669Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=0 command.real_time_ms=35 command.spawn_token_fork_ms=5 command.system_time_ms=24 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-03T10:31:44.108" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:31:34.629" grpc.time_ms=40.417 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.835852] gitaly[920]: time="2026-09-03T10:31:34.707Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE duration_ms=233ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 319.848460] gitaly[920]: time="2026-09-03T10:31:34.708Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:31:34.472" grpc.time_ms=234.961 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 319.877125] gitaly[920]: time="2026-09-03T10:31:34.726Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE diskcache=39454ae2-2277-4490-bad5-ed14c1f64bb2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:33.751" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 319.898609] systemd[1]: Finished setup-gitlab.service. gitlab # [ 319.900531] gitlab-workhorse[817]: time="2026-09-03T10:31:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 319.903698] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:34 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1958 gitlab # [ 319.908367] setup-gitlab-start[3361]: To http://gitlab/root/test-flake.git gitlab # [ 319.909910] setup-gitlab-start[3361]: * [new branch] master -> master gitlab # [ 319.911475] setup-gitlab-start[3361]: branch 'master' set up to track 'origin/master'. gitlab # [ 319.913367] gitaly[920]: time="2026-09-03T10:31:34.727Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=320 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13550 command.oublock=32 command.real_time_ms=966 command.spawn_token_fork_ms=2 command.system_time_ms=183 command.user_time_ms=137 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:33.751" grpc.time_ms=975.66 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 319.935263] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 321.11 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 321.046129] nixbot[3458]: {"ts": "2026-09-03T10:31:35.916Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 321.070110] nixbot[3458]: {"ts": "2026-09-03T10:31:35.941Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 321.086981] nixbot[3458]: {"ts": "2026-09-03T10:31:35.958Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 321.093629] nixbot[3458]: {"ts": "2026-09-03T10:31:35.963Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 321.100323] nixbot[3458]: {"ts": "2026-09-03T10:31:35.967Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 321.106616] nixbot[3458]: {"ts": "2026-09-03T10:31:35.973Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 321.113101] nixbot[3458]: {"ts": "2026-09-03T10:31:35.979Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 321.119496] nixbot[3458]: {"ts": "2026-09-03T10:31:35.981Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 321.126039] nixbot[3458]: {"ts": "2026-09-03T10:31:35.992Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 321.133647] nixbot[3458]: {"ts": "2026-09-03T10:31:35.994Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 321.140344] nixbot[3458]: {"ts": "2026-09-03T10:31:36.002Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 321.146605] nixbot[3458]: {"ts": "2026-09-03T10:31:36.013Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 321.153191] nixbot[3458]: {"ts": "2026-09-03T10:31:36.018Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 321.160054] nixbot[3458]: {"ts": "2026-09-03T10:31:36.020Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 321.166397] nixbot[3458]: {"ts": "2026-09-03T10:31:36.026Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 321.172676] nixbot[3458]: {"ts": "2026-09-03T10:31:36.029Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 321.178575] nixbot[3458]: {"ts": "2026-09-03T10:31:36.032Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 321.184254] nixbot[3458]: {"ts": "2026-09-03T10:31:36.034Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 321.189540] nixbot[3458]: {"ts": "2026-09-03T10:31:36.041Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 321.195071] nixbot[3458]: {"ts": "2026-09-03T10:31:36.043Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 321.200526] nixbot[3458]: {"ts": "2026-09-03T10:31:36.045Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 321.205190] nixbot[3458]: {"ts": "2026-09-03T10:31:36.051Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 321.209668] nixbot[3458]: {"ts": "2026-09-03T10:31:36.053Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 321.213978] nixbot[3458]: {"ts": "2026-09-03T10:31:36.055Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 321.218100] nixbot[3458]: {"ts": "2026-09-03T10:31:36.057Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 321.222093] nixbot[3458]: {"ts": "2026-09-03T10:31:36.060Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"} gitlab # [ 321.225970] nixbot[3458]: {"ts": "2026-09-03T10:31:36.062Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"} gitlab # [ 321.229647] nixbot[3458]: {"ts": "2026-09-03T10:31:36.064Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"} gitlab # [ 321.232979] nixbot[3458]: {"ts": "2026-09-03T10:31:36.066Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"} gitlab # [ 321.608610] nixbot[3458]: INFO: Started server process [3458] gitlab # [ 321.611381] nixbot[3458]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 321.631902] nixbot[3458]: INFO: ::ffff:127.0.0.1:42896 - "GET /health HTTP/1.1" 200 OK gitlab # [ 321.640828] systemd[1]: Started nixbot CI service. gitlab # [ 321.643043] systemd[1]: Reached target Multi-User System. gitlab # [ 321.645639] systemd[1]: Startup finished in 736ms (kernel) + 4.367s (initrd) + 5min 16.539s (userspace) = 5min 21.642s. gitlab: (finished: waiting for unit nixbot.service, in 1.10 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 321.818419] nixbot[3458]: INFO: ::ffff:127.0.0.1:48956 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 321.999409] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 119 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds) gitlab # [ 322.694992] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:37 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1064 gitlab # [ 322.699674] nixbot[3458]: {"ts": "2026-09-03T10:31:37.569Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 322.750643] nixbot[3458]: {"ts": "2026-09-03T10:31:37.621Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 322.897407] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 134 gitlab # [ 322.903913] nixbot[3458]: {"ts": "2026-09-03T10:31:37.770Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 322.910986] nixbot[3458]: {"ts": "2026-09-03T10:31:37.774Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 323.166500] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 105 gitlab # [ 323.171524] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:38 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 261 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.17 seconds) gitlab # [ 323.177921] nixbot[3458]: {"ts": "2026-09-03T10:31:38.042Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab # [ 323.374673] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:38 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 188 gitlab # [ 323.383120] nixbot[3458]: {"ts": "2026-09-03T10:31:38.248Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 323.446505] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 55 gitlab # [ 323.462006] nixbot[3458]: {"ts": "2026-09-03T10:31:38.325Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 323.666831] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:38 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 204 gitlab # [ 323.673492] nixbot[3458]: {"ts": "2026-09-03T10:31:38.539Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 323.810346] gitaly[920]: time="2026-09-03T10:31:38.680Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5Z9H6XNE2FJAZTGH11XQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-03T10:32:08.054" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:31:38.654" grpc.time_ms=24.953 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.851808] gitaly[920]: time="2026-09-03T10:31:38.707Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5Z9H6XNE2FJAZTGH11XQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:32:08.105" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:31:38.705" grpc.time_ms=1.218 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.874910] gitaly[920]: time="2026-09-03T10:31:38.727Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5Z9H6XNE2FJAZTGH11XQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-03T10:31:48.192" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:31:38.713" grpc.time_ms=13.735 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 323.907634] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 233 gitlab # [ 323.912886] nixbot[3458]: {"ts": "2026-09-03T10:31:38.780Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 324.075373] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 157 gitlab # [ 324.083192] nixbot[3458]: {"ts": "2026-09-03T10:31:38.948Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 324.091328] nixbot[3458]: {"ts": "2026-09-03T10:31:38.956Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 324.262974] gitaly[920]: time="2026-09-03T10:31:39.134Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5ZRMD9ESJJABSW22PVXD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.118" grpc.time_ms=15.619 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 324.302112] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 106 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.19 seconds) gitlab # [ 324.360981] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 129 (finished: subtest: project discovered and webhook registered, in 2.54 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 324.423936] gitaly[920]: time="2026-09-03T10:31:39.295Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5ZW3MNDDVEC1S1CMQ3VD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.277" pid=920 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 324.456310] gitaly[920]: time="2026-09-03T10:31:39.295Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5ZW3MNDDVEC1S1CMQ3VD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.277" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 324.480455] gitlab-workhorse[817]: time="2026-09-03T10:31:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 324.483247] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 157 gitlab # [ 324.486141] gitaly[920]: time="2026-09-03T10:31:39.301Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5ZW3MNDDVEC1S1CMQ3VD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.277" grpc.time_ms=18.252 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 324.504968] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:39 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 40 gitlab # [ 324.575643] gitaly[920]: time="2026-09-03T10:31:39.447Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6016WZRG22T5V1M881BC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.420" pid=920 remote_ip="2001:db8:1::1" request_sha=4afed0ecdf164d08c32eae6098dfeb1c41103d8b response_bytes=223 span.kind=server system=grpc gitlab # [ 324.588823] gitaly[920]: time="2026-09-03T10:31:39.447Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=17 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6016WZRG22T5V1M881BC grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.420" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 324.603054] gitlab-workhorse[817]: time="2026-09-03T10:31:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=223 gitlab # [ 324.605239] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 146 gitlab # [ 324.607134] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:39 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 95 gitlab # [ 324.609417] gitaly[920]: time="2026-09-03T10:31:39.448Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=1 command.system_time_ms=17 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6016WZRG22T5V1M881BC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.420" grpc.time_ms=26.92 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # Enumerating objects: 5, done. gitlab # [ 324.625345] gitaly[920]: time="2026-09-03T10:31:39.465Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1KD603AFPFQS07A55CC3JQY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.449" grpc.time_ms=15.324 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 324.706186] gitaly[920]: time="2026-09-03T10:31:39.577Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD607N89C50EER482SJNKV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.569" grpc.time_ms=8.294 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 324.720739] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:39 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 69 gitlab # [ 324.914078] gitaly[920]: time="2026-09-03T10:31:39.784Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-03T10:32:09.164" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-03T10:31:39.765" grpc.time_ms=18.5 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 324.954869] gitaly[920]: time="2026-09-03T10:31:39.805Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M1KD6080S49E2DXHY8FE7BYJ duration_ms=115ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 324.989888] gitaly[920]: time="2026-09-03T10:31:39.861Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD609WPWVH6YT51M0F8X43 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.850" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 325.018897] gitaly[920]: time="2026-09-03T10:31:39.862Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD609WPWVH6YT51M0F8X43 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.850" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 325.049333] gitlab-workhorse[817]: time="2026-09-03T10:31:39Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 325.053889] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:39 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 291 gitlab # [ 325.058210] gitaly[920]: time="2026-09-03T10:31:39.862Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD609WPWVH6YT51M0F8X43 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.850" grpc.time_ms=12.646 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 325.085156] gitaly[920]: time="2026-09-03T10:31:39.868Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M1KD6080S49E2DXHY8FE7BYJ duration_ms=63ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 325.092096] gitaly[920]: time="2026-09-03T10:31:39.869Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:31:39.688" grpc.time_ms=180.727 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 325.109654] gitaly[920]: time="2026-09-03T10:31:39.917Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:31:39.915" grpc.time_ms=2.059 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 325.124808] gitaly[920]: time="2026-09-03T10:31:39.953Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:31:39.952" grpc.time_ms=0.9 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 325.137775] gitaly[920]: time="2026-09-03T10:31:39.982Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:31:39.981" grpc.time_ms=1.006 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 325.149472] gitaly[920]: time="2026-09-03T10:31:40.000Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1KD60MEBNHK52ZE1MENHMM3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.990" grpc.time_ms=9.621 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 325.163309] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:40 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 80 gitlab # [ 325.213351] gitaly[920]: time="2026-09-03T10:31:40.084Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD60Q2NXQQB6YJ3DJ5YD6B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:40.066" pid=920 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 325.239646] gitaly[920]: time="2026-09-03T10:31:40.084Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD60Q2NXQQB6YJ3DJ5YD6B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:40.066" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 325.264560] gitlab-workhorse[817]: time="2026-09-03T10:31:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 325.267719] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:40 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 83 gitlab # [ 325.271459] gitaly[920]: time="2026-09-03T10:31:40.085Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD60Q2NXQQB6YJ3DJ5YD6B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:40.066" grpc.time_ms=18.3 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # To http://gitlab/root/test-flake.git gitlab # [ 325.294519] gitaly[920]: time="2026-09-03T10:31:40.122Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M1KD6080S49E2DXHY8FE7BYJ duration_ms=97ns method=POST pid=920 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # 9e55eca..800a765 [ 325.298795] gitaly[920]: time="2026-09-03T10:31:40.122Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:31:40.024" grpc.time_ms=97.856 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # master -> master[ 325.311956] gitaly[920]: time="2026-09-03T10:31:40.143Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ diskcache=9dcedd7d-9f89-494f-8d06-db2a0443f0a1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.607" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # gitlab # [ 325.323490] gitlab-workhorse[817]: time="2026-09-03T10:31:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 325.325643] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:40 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 622 gitlab # [ 325.327625] gitaly[920]: time="2026-09-03T10:31:40.143Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=175 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13211 command.oublock=32 command.real_time_ms=522 command.spawn_token_fork_ms=2 command.system_time_ms=92 command.user_time_ms=83 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:39.607" grpc.time_ms=536.109 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.99 seconds) gitlab # [ 325.342609] gitaly[920]: time="2026-09-03T10:31:40.182Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:32:10.081" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:31:40.181" grpc.time_ms=0.622 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab # [ 325.354985] gitaly[920]: time="2026-09-03T10:31:40.212Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=589 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-03T10:32:10.104" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:31:40.205" grpc.time_ms=7.513 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.369415] gitaly[920]: time="2026-09-03T10:31:40.232Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:31:50.224" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:31:40.224" grpc.time_ms=7.341 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.382718] gitaly[920]: time="2026-09-03T10:31:40.253Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=6 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:31:50.240" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:31:40.240" grpc.time_ms=12.373 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 325.482769] nixbot[3458]: INFO: ::ffff:127.0.0.1:48958 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.09 seconds) gitlab # [ 325.484918] gitaly[920]: time="2026-09-03T10:31:40.354Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-03T10:31:50.003" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:40.353" grpc.time_ms=0.488 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.506534] gitaly[920]: time="2026-09-03T10:31:40.377Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-03T10:31:50.015" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:31:40.366" grpc.time_ms=11.07 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.570688] gitaly[920]: time="2026-09-03T10:31:40.442Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:31:40.441" grpc.time_ms=0.455 pid=920 span.kind=server system=grpc gitlab # [ 325.632639] gitaly[920]: time="2026-09-03T10:31:40.504Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:31:40.503" grpc.time_ms=0.791 pid=920 span.kind=server system=grpc gitlab # [ 325.660285] gitaly[920]: time="2026-09-03T10:31:40.517Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X diskcache=faf96a50-bb8d-4a41-ba36-4ca34c9d56a2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-03T10:31:50.033" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:40.384" pid=920 ref=refs/keep-around/9e55ecafd40c59105acc0d514213c786ac0b6e00 remote_ip="2001:db8:1::1" revision=9e55ecafd40c59105acc0d514213c786ac0b6e00 span.kind=server system=grpc username=root gitlab # [ 325.687475] gitaly[920]: time="2026-09-03T10:31:40.518Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=117 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5173 command.oublock=8 command.real_time_ms=126 command.spawn_token_fork_ms=2 command.system_time_ms=62 command.user_time_ms=55 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-03T10:31:50.033" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:31:40.384" grpc.time_ms=133.99 pid=920 ref=refs/keep-around/9e55ecafd40c59105acc0d514213c786ac0b6e00 remote_ip="2001:db8:1::1" revision=9e55ecafd40c59105acc0d514213c786ac0b6e00 span.kind=server system=grpc username=root gitlab # [ 325.711255] gitaly[920]: time="2026-09-03T10:31:40.525Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:32:10.423" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:31:40.524" grpc.time_ms=0.575 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 325.852115] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 600 gitlab # [ 325.860112] nixbot[3458]: {"ts": "2026-09-03T10:31:40.724Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 \"HTTP/1.1 201 Created\""} gitlab # [ 325.870270] nixbot[3458]: {"ts": "2026-09-03T10:31:40.736Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-9e55ecafd40c-0"} gitlab # [ 326.130593] nixbot[3458]: {"ts": "2026-09-03T10:31:41.001Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-9e55ecafd40c-0", "argv0": "bwrap"} gitlab # [ 326.301197] systemd[1]: Started Nix Daemon. gitlab # [ 326.407822] nix-daemon[3684]: accepted connection from pid 3679, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 326.542659] nixbot[3458]: INFO: ::ffff:127.0.0.1:48962 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 327.597344] nixbot[3458]: INFO: ::ffff:127.0.0.1:48974 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 328.651753] nixbot[3458]: INFO: ::ffff:127.0.0.1:48980 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 329.705093] nixbot[3458]: INFO: ::ffff:127.0.0.1:48982 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 330.762803] nixbot[3458]: INFO: ::ffff:127.0.0.1:48998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab # [ 331.034571] nix-daemon[3684]: accepted connection from pid 3711, user nixbot gitlab # [ 331.057804] nix-daemon[3684]: accepted connection from pid 3679, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 331.819202] nixbot[3458]: INFO: ::ffff:127.0.0.1:33458 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 332.875417] nixbot[3458]: INFO: ::ffff:127.0.0.1:33466 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 333.930114] nixbot[3458]: INFO: ::ffff:127.0.0.1:33474 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 334.982984] nixbot[3458]: INFO: ::ffff:127.0.0.1:33478 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab # [ 335.776577] nix-daemon[3684]: accepted connection from pid 3679, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 335.990264] gitaly[920]: time="2026-09-03T10:31:50.859Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6B6HA5MM01EJRGCQ0041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:32:20.757" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:31:50.857" grpc.time_ms=1.059 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 336.043484] nixbot[3458]: INFO: ::ffff:127.0.0.1:33494 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab # [ 336.272485] gitaly[920]: time="2026-09-03T10:31:51.143Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6B6HA5MM01EJRGCQ0041 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:32:01.095" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:31:51.126" grpc.time_ms=17.179 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.456913] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 589 gitlab # [ 336.460145] nixbot[3458]: {"ts": "2026-09-03T10:31:51.330Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 \"HTTP/1.1 201 Created\""} gitlab # [ 336.533560] gitaly[920]: time="2026-09-03T10:31:51.404Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6BSA9CH1B51NB7F7MFB8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:32:21.302" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:31:51.403" grpc.time_ms=1.026 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.603683] gitaly[920]: time="2026-09-03T10:31:51.475Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6BSA9CH1B51NB7F7MFB8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:32:01.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:31:51.460" grpc.time_ms=14.056 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 336.684838] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:51 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 217 gitlab # [ 336.692801] nixbot[3458]: {"ts": "2026-09-03T10:31:51.558Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 \"HTTP/1.1 201 Created\""} gitlab # [ 336.936263] gitaly[920]: time="2026-09-03T10:31:51.807Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6C0R2DXW1AQRAZ93BZ2E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:32:21.205" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:31:51.806" grpc.time_ms=1.008 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 337.037176] gitaly[920]: time="2026-09-03T10:31:51.907Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6C0R2DXW1AQRAZ93BZ2E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:32:01.019" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:31:51.890" grpc.time_ms=17.288 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 337.078921] nixbot[3458]: INFO: ::ffff:127.0.0.1:33506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab # [ 337.157917] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 452 gitlab # [ 337.166187] nixbot[3458]: {"ts": "2026-09-03T10:31:52.030Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 \"HTTP/1.1 201 Created\""} gitlab # [ 337.491241] gitaly[920]: time="2026-09-03T10:31:52.362Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6CNSSP9CTQWD6DB0T9HJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:52.346" grpc.time_ms=15.911 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.532443] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:52 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 114 gitlab # [ 337.608352] gitaly[920]: time="2026-09-03T10:31:52.479Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6CSH3N94R3TJ3W9MVMJP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:52.460" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 337.636367] gitaly[920]: time="2026-09-03T10:31:52.479Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6CSH3N94R3TJ3W9MVMJP grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:52.460" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.661302] gitlab-workhorse[817]: time="2026-09-03T10:31:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 337.664182] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 111 gitlab # [ 337.667178] gitaly[920]: time="2026-09-03T10:31:52.480Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6CSH3N94R3TJ3W9MVMJP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:52.460" grpc.time_ms=19.632 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.719918] gitaly[920]: time="2026-09-03T10:31:52.591Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6CX3CWX31WKEX77ENA3Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:52.567" pid=920 remote_ip="2001:db8:1::1" request_sha=d098a3bbd182ce2dfa6f987b33b8cb0f8299ecb9 response_bytes=336 span.kind=server system=grpc gitlab # [ 337.740698] gitaly[920]: time="2026-09-03T10:31:52.591Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1128 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6CX3CWX31WKEX77ENA3Q grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:52.567" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 337.763883] gitlab-workhorse[817]: time="2026-09-03T10:31:52Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=336 gitlab # [ 337.766799] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:31:52 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 336 "" "git/2.55.0" 109 gitlab # [ 337.769506] gitaly[920]: time="2026-09-03T10:31:52.592Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1128 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=1 command.system_time_ms=15 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6CX3CWX31WKEX77ENA3Q grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:31:52.567" grpc.time_ms=25.21 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab # [ 338.141473] nixbot[3458]: INFO: ::ffff:127.0.0.1:33512 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 339.194714] nixbot[3458]: INFO: ::ffff:127.0.0.1:33526 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 340.251350] nixbot[3458]: INFO: ::ffff:127.0.0.1:33540 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 341.307966] nixbot[3458]: INFO: ::ffff:127.0.0.1:55544 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 342.363755] nixbot[3458]: INFO: ::ffff:127.0.0.1:55554 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 343.416268] nixbot[3458]: INFO: ::ffff:127.0.0.1:55560 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 344.471254] nixbot[3458]: INFO: ::ffff:127.0.0.1:55568 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 345.527437] nixbot[3458]: INFO: ::ffff:127.0.0.1:55572 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 346.584069] nixbot[3458]: INFO: ::ffff:127.0.0.1:55584 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 347.637141] nixbot[3458]: INFO: ::ffff:127.0.0.1:55596 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 348.689634] nixbot[3458]: INFO: ::ffff:127.0.0.1:55602 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 349.747126] nixbot[3458]: INFO: ::ffff:127.0.0.1:55608 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 350.804339] nixbot[3458]: INFO: ::ffff:127.0.0.1:55620 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 351.858187] nixbot[3458]: INFO: ::ffff:127.0.0.1:34408 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 352.911317] nixbot[3458]: INFO: ::ffff:127.0.0.1:34422 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 353.963710] nixbot[3458]: INFO: ::ffff:127.0.0.1:34436 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 355.017510] nixbot[3458]: INFO: ::ffff:127.0.0.1:34448 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 356.074006] nixbot[3458]: INFO: ::ffff:127.0.0.1:34458 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 357.131397] nixbot[3458]: INFO: ::ffff:127.0.0.1:34468 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 358.186979] nixbot[3458]: INFO: ::ffff:127.0.0.1:34474 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 359.242809] nixbot[3458]: INFO: ::ffff:127.0.0.1:34490 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab # [ 359.583497] sidekiq-cluster[3415]: 2026-09-03T10:32:14.453Z pid=3415 tid=yrj INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3415, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>424878080} gitlab # [ 359.857117] sidekiq-cluster[3415]: W, [2026-09-03T10:32:14.728365 #3415] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 359.990290] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:32:14.861Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 360.298777] nixbot[3458]: INFO: ::ffff:127.0.0.1:34506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 361.354623] nixbot[3458]: INFO: ::ffff:127.0.0.1:59028 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 362.407808] nixbot[3458]: INFO: ::ffff:127.0.0.1:59030 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab # [ 362.927344] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:32:17.797Z","message":"GitLab reliable fetch activated!"} gitlab # [ 362.932462] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:32:17.797Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 363.460784] nixbot[3458]: INFO: ::ffff:127.0.0.1:59044 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 364.517949] nixbot[3458]: INFO: ::ffff:127.0.0.1:59054 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 365.575603] nixbot[3458]: INFO: ::ffff:127.0.0.1:59070 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 366.630803] nixbot[3458]: INFO: ::ffff:127.0.0.1:59084 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 367.686457] nixbot[3458]: INFO: ::ffff:127.0.0.1:59100 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 368.739731] nixbot[3458]: INFO: ::ffff:127.0.0.1:59106 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 369.791610] nixbot[3458]: INFO: ::ffff:127.0.0.1:59114 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 370.847479] nixbot[3458]: INFO: ::ffff:127.0.0.1:59942 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 371.902638] nixbot[3458]: INFO: ::ffff:127.0.0.1:59954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 372.959600] nixbot[3458]: INFO: ::ffff:127.0.0.1:59968 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 374.015393] nixbot[3458]: INFO: ::ffff:127.0.0.1:59976 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 375.069166] nixbot[3458]: INFO: ::ffff:127.0.0.1:59986 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 376.124976] nixbot[3458]: INFO: ::ffff:127.0.0.1:59990 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 377.182829] nixbot[3458]: INFO: ::ffff:127.0.0.1:59998 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 378.239786] nixbot[3458]: INFO: ::ffff:127.0.0.1:60012 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 379.295481] nixbot[3458]: INFO: ::ffff:127.0.0.1:60018 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 380.352385] nixbot[3458]: INFO: ::ffff:127.0.0.1:60032 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 381.407436] nixbot[3458]: INFO: ::ffff:127.0.0.1:55930 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab # [ 382.462192] nixbot[3458]: INFO: ::ffff:127.0.0.1:55934 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 383.516684] nixbot[3458]: INFO: ::ffff:127.0.0.1:55936 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 384.570458] nixbot[3458]: INFO: ::ffff:127.0.0.1:55942 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 385.627178] nixbot[3458]: INFO: ::ffff:127.0.0.1:55948 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 386.680746] nixbot[3458]: INFO: ::ffff:127.0.0.1:55954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 387.735264] nixbot[3458]: INFO: ::ffff:127.0.0.1:55964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 388.790848] nixbot[3458]: INFO: ::ffff:127.0.0.1:55968 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 389.845497] nixbot[3458]: INFO: ::ffff:127.0.0.1:55972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 390.901017] nixbot[3458]: INFO: ::ffff:127.0.0.1:34940 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 391.954518] nixbot[3458]: INFO: ::ffff:127.0.0.1:34950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 393.009558] nixbot[3458]: INFO: ::ffff:127.0.0.1:34956 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 394.064326] nixbot[3458]: INFO: ::ffff:127.0.0.1:34960 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 395.117732] nixbot[3458]: INFO: ::ffff:127.0.0.1:34974 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 396.169979] nixbot[3458]: INFO: ::ffff:127.0.0.1:34986 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 397.226110] nixbot[3458]: INFO: ::ffff:127.0.0.1:34988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 398.279233] nixbot[3458]: INFO: ::ffff:127.0.0.1:34994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab # [ 398.766569] postgres[3980]: [3980] ERROR: relation "table_without_models" does not exist gitlab # [ 398.770446] postgres[3980]: [3980] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab # [ 399.333497] nixbot[3458]: INFO: ::ffff:127.0.0.1:35000 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 400.387585] nixbot[3458]: INFO: ::ffff:127.0.0.1:35016 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 401.443273] nixbot[3458]: INFO: ::ffff:127.0.0.1:43896 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 402.496299] nixbot[3458]: INFO: ::ffff:127.0.0.1:43898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab # [ 403.479061] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:32:58.349Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 403.479484] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:32:58.349Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 403.479607] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:32:58.349Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 403.479772] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:32:58.349Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 403.479896] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:32:58.350Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 403.553583] nixbot[3458]: INFO: ::ffff:127.0.0.1:43912 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 404.611022] nixbot[3458]: INFO: ::ffff:127.0.0.1:43918 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 405.665111] nixbot[3458]: INFO: ::ffff:127.0.0.1:43934 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab # [ 406.067204] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:00.937Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4eb6a3db92ec08ffdbc49368","created_at":"2026-09-03T10:31:30.921Z","trace_propagation_headers":{"sentry-trace":"d4a6907453c441c4a44c705a6e8be2db-ed19062d595f41cc","baggage":"sentry-trace_id=d4a6907453c441c4a44c705a6e8be2db,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD5PAQ4DW1A1C86PVVAQBN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:30.972Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4eb6a3db92ec08ffdbc49368: start","job_status":"start","queue_duration_s":89.964429,"scheduling_latency_s":89.96448} gitlab # [ 406.312176] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:01.182Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4eb6a3db92ec08ffdbc49368","created_at":"2026-09-03T10:31:30.921Z","trace_propagation_headers":{"sentry-trace":"d4a6907453c441c4a44c705a6e8be2db-ed19062d595f41cc","baggage":"sentry-trace_id=d4a6907453c441c4a44c705a6e8be2db,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD5PAQ4DW1A1C86PVVAQBN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:30.972Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4eb6a3db92ec08ffdbc49368: done: 0.24557 sec","job_status":"done","queue_duration_s":89.964429,"scheduling_latency_s":89.96448,"redis_calls":23,"redis_duration_s":0.008563,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.004402,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00243,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001731,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.127964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12749418,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.24557,"completed_at":"2026-09-03T10:33:01.182Z","load_balancing_strategy":"primary","db_duration_s":0.074315,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 406.412980] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:01.185Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"2237b002122aff46e15d14e6","created_at":"2026-09-03T10:31:30.987Z","trace_propagation_headers":{"sentry-trace":"d4a6907453c441c4a44c705a6e8be2db-ed19062d595f41cc","baggage":"sentry-trace_id=d4a6907453c441c4a44c705a6e8be2db,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD5PAQ4DW1A1C86PVVAQBN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:30.994Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-2237b002122aff46e15d14e6: start","job_status":"start","queue_duration_s":90.19084,"scheduling_latency_s":90.190879} gitlab # [ 406.502903] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:01.373Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"2237b002122aff46e15d14e6","created_at":"2026-09-03T10:31:30.987Z","trace_propagation_headers":{"sentry-trace":"d4a6907453c441c4a44c705a6e8be2db-ed19062d595f41cc","baggage":"sentry-trace_id=d4a6907453c441c4a44c705a6e8be2db,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD5PAQ4DW1A1C86PVVAQBN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:30.994Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-2237b002122aff46e15d14e6: done: 0.187898 sec","job_status":"done","queue_duration_s":90.19084,"scheduling_latency_s":90.190879,"redis_calls":14,"redis_duration_s":0.005164,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001128,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002367,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.138545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14368934,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.187898,"completed_at":"2026-09-03T10:33:01.373Z","load_balancing_strategy":"primary","db_duration_s":0.038375,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 406.597927] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:01.376Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"6f58efcd16095d2649ae35c1","created_at":"2026-09-03T10:31:31.555Z","trace_propagation_headers":{"sentry-trace":"d4a6907453c441c4a44c705a6e8be2db-ed19062d595f41cc","baggage":"sentry-trace_id=d4a6907453c441c4a44c705a6e8be2db,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD5PAQ4DW1A1C86PVVAQBN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:31.563Z","job_size_bytes":5,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-6f58efcd16095d2649ae35c1: start","job_status":"start","queue_duration_s":89.813231,"scheduling_latency_s":89.813258} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 406.721666] nixbot[3458]: INFO: ::ffff:127.0.0.1:43950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab # [ 406.733905] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:01.604Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"6f58efcd16095d2649ae35c1","created_at":"2026-09-03T10:31:31.555Z","trace_propagation_headers":{"sentry-trace":"d4a6907453c441c4a44c705a6e8be2db-ed19062d595f41cc","baggage":"sentry-trace_id=d4a6907453c441c4a44c705a6e8be2db,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD5PAQ4DW1A1C86PVVAQBN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:31.563Z","job_size_bytes":5,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-6f58efcd16095d2649ae35c1: done: 0.228774 sec","job_status":"done","queue_duration_s":89.813231,"scheduling_latency_s":89.813258,"redis_calls":12,"redis_duration_s":0.0037630000000000003,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000929,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002233,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000601,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.178674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038166,"duration_s":0.228774,"completed_at":"2026-09-03T10:33:01.604Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042366,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 406.826375] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:01.607Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"8f09c48d8f7a56eddc40b800","created_at":"2026-09-03T10:31:31.596Z","trace_propagation_headers":{"sentry-trace":"d4a6907453c441c4a44c705a6e8be2db-ed19062d595f41cc","baggage":"sentry-trace_id=d4a6907453c441c4a44c705a6e8be2db,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD5PAQ4DW1A1C86PVVAQBN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:31.602Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-8f09c48d8f7a56eddc40b800: start","job_status":"start","queue_duration_s":90.004968,"scheduling_latency_s":90.004988} gitlab # [ 407.109839] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:01.979Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"8f09c48d8f7a56eddc40b800","created_at":"2026-09-03T10:31:31.596Z","trace_propagation_headers":{"sentry-trace":"d4a6907453c441c4a44c705a6e8be2db-ed19062d595f41cc","baggage":"sentry-trace_id=d4a6907453c441c4a44c705a6e8be2db,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD5PAQ4DW1A1C86PVVAQBN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:31.602Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-8f09c48d8f7a56eddc40b800: done: 0.372201 sec","job_status":"done","queue_duration_s":90.004968,"scheduling_latency_s":90.004988,"redis_calls":11,"redis_duration_s":0.003652,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000771,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002215,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000666,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.324,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.324,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.265726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009902,"duration_s":0.372201,"completed_at":"2026-09-03T10:33:01.979Z","load_balancing_strategy":"primary","db_duration_s":0.114548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 407.207318] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:01.982Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"34873d84ea3605f2146175e4","created_at":"2026-09-03T10:31:31.605Z","trace_propagation_headers":{"sentry-trace":"d4a6907453c441c4a44c705a6e8be2db-ed19062d595f41cc","baggage":"sentry-trace_id=d4a6907453c441c4a44c705a6e8be2db,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD5PAQ4DW1A1C86PVVAQBN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:31.610Z","job_size_bytes":89,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-34873d84ea3605f2146175e4: start","job_status":"start","queue_duration_s":90.37186,"scheduling_latency_s":90.371895} gitlab # [ 407.228800] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:02.042Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"34873d84ea3605f2146175e4","created_at":"2026-09-03T10:31:31.605Z","trace_propagation_headers":{"sentry-trace":"d4a6907453c441c4a44c705a6e8be2db-ed19062d595f41cc","baggage":"sentry-trace_id=d4a6907453c441c4a44c705a6e8be2db,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD5PAQ4DW1A1C86PVVAQBN","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:31.610Z","job_size_bytes":89,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-34873d84ea3605f2146175e4: done: 0.060274 sec","job_status":"done","queue_duration_s":90.37186,"scheduling_latency_s":90.371895,"redis_calls":11,"redis_duration_s":0.003423,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000971,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001862,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00059,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049018,"duration_s":0.060274,"completed_at":"2026-09-03T10:33:02.042Z","load_balancing_strategy":"primary","db_duration_s":0.00972,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 407.278627] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:02.045Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 9e55ecafd40c59105acc0d514213c786ac0b6e00 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"64b7c0ae08809744bc0081d6","created_at":"2026-09-03T10:31:34.536Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-2aed1c5957874bde","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:34.543Z","job_size_bytes":185,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-64b7c0ae08809744bc0081d6: start","job_status":"start","queue_duration_s":87.501248,"scheduling_latency_s":87.501273} gitlab # [ 407.297035] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:02.068Z","message":"changes: \"0000000000000000000000000000000000000000 9e55ecafd40c59105acc0d514213c786ac0b6e00 refs/heads/master\\n\""} gitlab # [ 407.300601] gitaly[920]: time="2026-09-03T10:33:02.126Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:12.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:02.112" grpc.time_ms=14.246 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 407.314216] gitaly[920]: time="2026-09-03T10:33:02.150Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:33:12.027" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:33:02.138" grpc.time_ms=11.903 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 407.390431] gitaly[920]: time="2026-09-03T10:33:02.261Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-03T10:33:12.136" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:02.247" grpc.time_ms=14.184 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 407.470904] gitaly[920]: time="2026-09-03T10:33:02.342Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:33:02.341" grpc.time_ms=0.701 pid=920 span.kind=server system=grpc gitlab # [ 407.529931] gitaly[920]: time="2026-09-03T10:33:02.401Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:33:02.400" grpc.time_ms=0.786 pid=920 span.kind=server system=grpc gitlab # [ 407.559479] gitaly[920]: time="2026-09-03T10:33:02.414Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE diskcache=5e37048a-424d-4d0f-be3b-705d24d0f3b7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-03T10:33:12.172" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:33:02.283" pid=920 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 407.583110] gitaly[920]: time="2026-09-03T10:33:02.415Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=140 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5162 command.oublock=8 command.real_time_ms=124 command.spawn_token_fork_ms=1 command.system_time_ms=76 command.user_time_ms=64 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-03T10:33:12.172" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:33:02.283" grpc.time_ms=131.548 pid=920 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 407.605767] gitaly[920]: time="2026-09-03T10:33:02.444Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-03T10:33:12.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:33:02.443" grpc.time_ms=0.299 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 407.620053] gitaly[920]: time="2026-09-03T10:33:02.475Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=860 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=12 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-03T10:33:12.010" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:02.451" grpc.time_ms=24.2 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.07 seconds) gitlab # [ 407.769555] gitaly[920]: time="2026-09-03T10:33:02.640Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-09-03T10:33:32.027" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:02.628" grpc.time_ms=12.012 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 407.817169] nixbot[3458]: INFO: ::ffff:127.0.0.1:43966 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab # [ 407.835896] gitaly[920]: time="2026-09-03T10:33:02.707Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-03T10:33:12.265" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:33:02.706" grpc.time_ms=0.553 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 407.865665] gitaly[920]: time="2026-09-03T10:33:02.722Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-03T10:33:12.271" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-09-03T10:33:02.711" grpc.time_ms=10.762 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 407.897439] gitaly[920]: time="2026-09-03T10:33:02.768Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:12.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:02.752" grpc.time_ms=16.564 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 407.924473] gitaly[920]: time="2026-09-03T10:33:02.795Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:12.028" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:02.779" grpc.time_ms=16.498 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 407.978707] gitaly[920]: time="2026-09-03T10:33:02.850Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-03T10:33:32.222" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:02.822" grpc.time_ms=27.031 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 408.657170] gitaly[920]: time="2026-09-03T10:33:03.527Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-03T10:33:13.084" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:03.525" grpc.time_ms=1.875 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 408.731503] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:03.600Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 9e55ecafd40c59105acc0d514213c786ac0b6e00 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"64b7c0ae08809744bc0081d6","created_at":"2026-09-03T10:31:34.536Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-2aed1c5957874bde","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:34.543Z","job_size_bytes":185,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-64b7c0ae08809744bc0081d6: done: 1.555444 sec","job_status":"done","queue_duration_s":87.501248,"scheduling_latency_s":87.501273,"gitaly_calls":13,"gitaly_duration_s":0.351295,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.070539,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.006594,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009715,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002527,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005767,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.028355,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.017581,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.09,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.307,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.352,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.09,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.062665,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00082546,"exclusive_lock_hold_duration_s":0.04657518,"duration_s":1.555444,"completed_at":"2026-09-03T10:33:03.600Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.157953,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab # [ 408.837504] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:03.604Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","9e55ecafd40c59105acc0d514213c786ac0b6e00 800a76504cdb0e3a9d9162945e09f3675c861f1a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7fd0f51edcf0f337548a0cea","created_at":"2026-09-03T10:31:40.078Z","trace_propagation_headers":{"sentry-trace":"0f6485e5b71a4de690e6e0fb50f3285b-8df7355503b34f8b","baggage":"sentry-trace_id=0f6485e5b71a4de690e6e0fb50f3285b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD6080S49E2DXHY8FE7BYJ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:40.083Z","job_size_bytes":185,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7fd0f51edcf0f337548a0cea: start","job_status":"start","queue_duration_s":83.521029,"scheduling_latency_s":83.521077} gitlab # [ 408.860738] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:03.629Z","message":"changes: \"9e55ecafd40c59105acc0d514213c786ac0b6e00 800a76504cdb0e3a9d9162945e09f3675c861f1a refs/heads/master\\n\""} gitlab # [ 408.863896] gitaly[920]: time="2026-09-03T10:33:03.688Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:13.225" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:03.665" grpc.time_ms=22.827 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 408.882285] nixbot[3458]: INFO: ::ffff:127.0.0.1:43972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab # [ 408.884879] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:03.730Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ae07854c882e27ee57ca363e","created_at":"2026-09-03T10:33:03.726Z","trace_propagation_headers":{"sentry-trace":"0f6485e5b71a4de690e6e0fb50f3285b-d9f6eeda7c064ca9","baggage":"sentry-trace_id=0f6485e5b71a4de690e6e0fb50f3285b,sentry-release=Unknown"},"correlation_id":"01M1KD6080S49E2DXHY8FE7BYJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"5a38660cb97b7b364e676cc6","job_size_bytes":46,"pid":3415,"job_status":"deduplicated","message":"ProjectCacheWorker JID-ae07854c882e27ee57ca363e: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 408.902348] gitaly[920]: time="2026-09-03T10:33:03.722Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=4 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-03T10:33:13.261" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:33:03.702" grpc.time_ms=19.768 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 408.916462] gitaly[920]: time="2026-09-03T10:33:03.773Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-09-03T10:33:13.006" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:03.756" grpc.time_ms=16.664 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 408.929491] gitaly[920]: time="2026-09-03T10:33:03.800Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-09-03T10:33:33.181" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:03.782" grpc.time_ms=18.172 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 408.960681] gitaly[920]: time="2026-09-03T10:33:03.832Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-09-03T10:33:13.071" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-09-03T10:33:03.821" grpc.time_ms=10.415 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 408.998001] gitaly[920]: time="2026-09-03T10:33:03.863Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:13.098" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:03.848" grpc.time_ms=14.815 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 409.148590] gitaly[920]: time="2026-09-03T10:33:04.019Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-09-03T10:33:14.007" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:04.017" grpc.time_ms=2.138 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 409.195745] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:04.065Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","9e55ecafd40c59105acc0d514213c786ac0b6e00 800a76504cdb0e3a9d9162945e09f3675c861f1a refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"7fd0f51edcf0f337548a0cea","created_at":"2026-09-03T10:31:40.078Z","trace_propagation_headers":{"sentry-trace":"0f6485e5b71a4de690e6e0fb50f3285b-8df7355503b34f8b","baggage":"sentry-trace_id=0f6485e5b71a4de690e6e0fb50f3285b,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD6080S49E2DXHY8FE7BYJ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:31:40.083Z","job_size_bytes":185,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-7fd0f51edcf0f337548a0cea: done: 0.461222 sec","job_status":"done","queue_duration_s":83.521029,"scheduling_latency_s":83.521077,"gitaly_calls":7,"gitaly_duration_s":0.136663,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.03551,"redis_read_bytes":500,"redis_write_bytes":11944,"redis_cache_calls":9,"redis_cache_duration_s":0.004104,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001445,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5721,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005045,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.012464,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.012452,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.042,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.042,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.28016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00147484,"exclusive_lock_hold_duration_s":0.04630452,"duration_s":0.461222,"completed_at":"2026-09-03T10:33:04.065Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.043442,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 409.264180] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:04.069Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ac196e8d386a41789d247152","created_at":"2026-09-03T10:31:40.532Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-3a50186c03d54df4","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:40.543Z","job_size_bytes":65,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ac196e8d386a41789d247152: start","job_status":"start","queue_duration_s":83.526019,"scheduling_latency_s":83.526065} gitlab # [ 409.369104] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:04.239Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ac196e8d386a41789d247152","created_at":"2026-09-03T10:31:40.532Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-3a50186c03d54df4","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:40.543Z","job_size_bytes":65,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ac196e8d386a41789d247152: done: 0.170277 sec","job_status":"done","queue_duration_s":83.526019,"scheduling_latency_s":83.526065,"redis_calls":16,"redis_duration_s":0.006693,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003213,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002654,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000826,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116744,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0008158,"duration_s":0.170277,"completed_at":"2026-09-03T10:33:04.239Z","load_balancing_strategy":"primary","db_duration_s":0.038423,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 409.460048] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:04.242Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"47ef8fe7d36106ddb3a902ab","created_at":"2026-09-03T10:31:40.544Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-3a50186c03d54df4","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:40.553Z","job_size_bytes":65,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-47ef8fe7d36106ddb3a902ab: start","job_status":"start","queue_duration_s":83.68906,"scheduling_latency_s":83.689089} gitlab # [ 409.676218] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:04.547Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"47ef8fe7d36106ddb3a902ab","created_at":"2026-09-03T10:31:40.544Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-3a50186c03d54df4","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:40.553Z","job_size_bytes":65,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-47ef8fe7d36106ddb3a902ab: done: 0.30479 sec","job_status":"done","queue_duration_s":83.68906,"scheduling_latency_s":83.689089,"redis_calls":21,"redis_duration_s":0.007716000000000001,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003386,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002062,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002268,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.239565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005298,"duration_s":0.30479,"completed_at":"2026-09-03T10:33:04.547Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.053171,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 409.775442] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:04.550Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a2c23cf9306c214e35b85d33","created_at":"2026-09-03T10:31:40.694Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-3a50186c03d54df4","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:40.701Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a2c23cf9306c214e35b85d33: start","job_status":"start","queue_duration_s":83.848564,"scheduling_latency_s":83.848588} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.07 seconds) gitlab # [ 409.911021] gitaly[920]: time="2026-09-03T10:33:04.780Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:33:04.777" grpc.time_ms=3.382 pid=920 span.kind=server system=grpc gitlab # [ 409.940290] nixbot[3458]: INFO: ::ffff:127.0.0.1:43984 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab # [ 409.961040] gitaly[920]: time="2026-09-03T10:33:04.832Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:33:04.831" grpc.time_ms=0.85 pid=920 span.kind=server system=grpc gitlab # [ 410.009828] gitaly[920]: time="2026-09-03T10:33:04.881Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:33:04.880" grpc.time_ms=0.82 pid=920 span.kind=server system=grpc gitlab # [ 410.038335] gitaly[920]: time="2026-09-03T10:33:04.893Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X diskcache=fdeb0a94-5b5b-4db0-97ce-566a0dcf4f08 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-03T10:33:34.132" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:04.733" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 410.058729] gitaly[920]: time="2026-09-03T10:33:04.893Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=178 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7430 command.oublock=0 command.real_time_ms=153 command.spawn_token_fork_ms=1 command.system_time_ms=106 command.user_time_ms=72 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-03T10:33:34.132" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:04.733" grpc.time_ms=159.861 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 410.240973] gitaly[920]: time="2026-09-03T10:33:05.112Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-03T10:33:35.009" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:05.110" grpc.time_ms=1.713 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 410.302589] gitaly[920]: time="2026-09-03T10:33:05.173Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD60TTMJ5PSW6W66G8RH8X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:35.071" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:05.172" grpc.time_ms=1.384 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 410.348511] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:05.218Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a2c23cf9306c214e35b85d33","created_at":"2026-09-03T10:31:40.694Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-3a50186c03d54df4","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-03T10:31:40.701Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a2c23cf9306c214e35b85d33: done: 0.668784 sec","job_status":"done","queue_duration_s":83.848564,"scheduling_latency_s":83.848588,"gitaly_calls":3,"gitaly_duration_s":0.173569,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.039791,"redis_read_bytes":457,"redis_write_bytes":27998,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001693,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001753,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.014322,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.006301,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14492,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.00897,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000782,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00102,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003257,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.093,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.033,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.037,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.048,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.369583,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.5755389399999999,"duration_s":0.668784,"completed_at":"2026-09-03T10:33:05.218Z","load_balancing_strategy":"primary","db_duration_s":0.110442,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 410.428618] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:05.222Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"5a38660cb97b7b364e676cc6","created_at":"2026-09-03T10:33:02.155Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-f326edf50be84ce9","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:02.192Z","job_size_bytes":46,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-5a38660cb97b7b364e676cc6: start","job_status":"start","queue_duration_s":3.029197,"scheduling_latency_s":3.029234} gitlab # [ 410.446790] gitaly[920]: time="2026-09-03T10:33:05.315Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-09-03T16:33:05.304" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:33:05.304" grpc.time_ms=10.075 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 410.474711] gitaly[920]: time="2026-09-03T10:33:05.346Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-03T10:33:35.228" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:05.329" grpc.time_ms=16.717 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 410.519899] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:05.390Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"5a38660cb97b7b364e676cc6","created_at":"2026-09-03T10:33:02.155Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-f326edf50be84ce9","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:02.192Z","job_size_bytes":46,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-5a38660cb97b7b364e676cc6: done: 0.168707 sec","job_status":"done","queue_duration_s":3.029197,"scheduling_latency_s":3.029234,"gitaly_calls":2,"gitaly_duration_s":0.034053,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010772,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002219,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000921,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002271,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004197,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001164,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.105442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047318,"duration_s":0.168707,"completed_at":"2026-09-03T10:33:05.390Z","load_balancing_strategy":"primary","db_duration_s":0.018923,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 410.587475] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:05.392Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5d76e557cbc7645e0403ef46","created_at":"2026-09-03T10:33:02.227Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-f326edf50be84ce9","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:02.239Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5d76e557cbc7645e0403ef46: start","job_status":"start","queue_duration_s":3.153884,"scheduling_latency_s":3.153909} gitlab # [ 410.606768] gitaly[920]: time="2026-09-03T10:33:05.456Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE diskcache=2431308a-55fa-40d5-bb7a-9bd703c5adaf grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-03T16:33:05.426" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:05.427" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 410.617824] gitaly[920]: time="2026-09-03T10:33:05.457Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1175 command.oublock=0 command.real_time_ms=32 command.spawn_token_fork_ms=3 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-03T16:33:05.426" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:05.427" grpc.time_ms=29.66 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 410.639169] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:05.510Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5d76e557cbc7645e0403ef46","created_at":"2026-09-03T10:33:02.227Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-f326edf50be84ce9","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:02.239Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5d76e557cbc7645e0403ef46: done: 0.117308 sec","job_status":"done","queue_duration_s":3.153884,"scheduling_latency_s":3.153909,"gitaly_calls":1,"gitaly_duration_s":0.032977,"redis_calls":15,"redis_duration_s":0.004922,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000562,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000856,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001514,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.028,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.054864,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0835187,"duration_s":0.117308,"completed_at":"2026-09-03T10:33:05.510Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023207,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 410.686437] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:05.512Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"78992744e9b3bdf0a5e4e119","created_at":"2026-09-03T10:33:02.435Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-f326edf50be84ce9","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:02.439Z","job_size_bytes":23,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-78992744e9b3bdf0a5e4e119: start","job_status":"start","queue_duration_s":3.072756,"scheduling_latency_s":3.072778} gitlab # [ 410.702006] gitaly[920]: time="2026-09-03T10:33:05.565Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-09-03T10:33:35.447" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:05.547" grpc.time_ms=16.876 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 410.716708] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:05.587Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"78992744e9b3bdf0a5e4e119","created_at":"2026-09-03T10:33:02.435Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-f326edf50be84ce9","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:02.439Z","job_size_bytes":23,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-78992744e9b3bdf0a5e4e119: done: 0.074824 sec","job_status":"done","queue_duration_s":3.072756,"scheduling_latency_s":3.072778,"gitaly_calls":1,"gitaly_duration_s":0.019602,"redis_calls":16,"redis_duration_s":0.005601,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000599,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001597,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.002415,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.074824,"completed_at":"2026-09-03T10:33:05.587Z","load_balancing_strategy":"primary","db_duration_s":0.004504,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 410.761514] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:05.590Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"47c79136d085dc74f0ce83d1","created_at":"2026-09-03T10:33:03.272Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-f326edf50be84ce9","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:95a5f5a9bf684ba7239537301bae5814b74aac7d07f98d5a29c7971bde020dbf","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:03.282Z","job_size_bytes":467,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-47c79136d085dc74f0ce83d1: start","job_status":"start","queue_duration_s":2.307838,"scheduling_latency_s":2.307882} gitlab # [ 410.780382] gitaly[920]: time="2026-09-03T10:33:05.651Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:35.550" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:05.650" grpc.time_ms=0.961 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 410.800230] gitaly[920]: time="2026-09-03T10:33:05.671Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-03T10:33:15.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:05.656" grpc.time_ms=14.952 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.07 seconds) gitlab # [ 410.988892] nixbot[3458]: INFO: ::ffff:127.0.0.1:57086 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab # [ 411.000909] gitaly[920]: time="2026-09-03T10:33:05.871Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-03T10:33:35.770" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:05.870" grpc.time_ms=1.198 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 411.015954] gitaly[920]: time="2026-09-03T10:33:05.884Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=37 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-03T10:33:35.779" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:05.879" grpc.time_ms=4.125 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 411.188785] gitaly[920]: time="2026-09-03T10:33:06.060Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:16.032" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:06.043" grpc.time_ms=16.702 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 411.984349] gitaly[920]: time="2026-09-03T10:33:06.855Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=10 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-03T10:33:36.729" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:06.830" grpc.time_ms=25.124 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.06 seconds) gitlab # [ 412.018760] gitaly[920]: time="2026-09-03T10:33:06.888Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=7 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD5SN2R0HA4XT4ZG4ATXNE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-03T10:33:36.761" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:06.862" grpc.time_ms=26.285 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.052570] nixbot[3458]: INFO: ::ffff:127.0.0.1:57100 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab # [ 412.083804] sidekiq-cluster[3415]: {"severity":"WARN","time":"2026-09-03T10:33:06.954Z","class":"CreatePipelineWorker","correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"9e55ecafd40c59105acc0d514213c786ac0b6e00","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"9e55ecafd40c59105acc0d514213c786ac0b6e00","ref":"refs/heads/master"},"retry":0} gitlab # [ 412.104847] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:06.969Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"47c79136d085dc74f0ce83d1","created_at":"2026-09-03T10:33:03.272Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-f326edf50be84ce9","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:95a5f5a9bf684ba7239537301bae5814b74aac7d07f98d5a29c7971bde020dbf","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:03.282Z","job_size_bytes":467,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-47c79136d085dc74f0ce83d1: done: 1.378974 sec","job_status":"done","queue_duration_s":2.307838,"scheduling_latency_s":2.307882,"gitaly_calls":7,"gitaly_duration_s":0.118107,"redis_calls":51,"redis_duration_s":0.014953,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001376,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.005937,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002209,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003504,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001927,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.174962,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006888,"duration_s":1.378974,"completed_at":"2026-09-03T10:33:06.969Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.087588,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 412.179652] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:06.972Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"b8db84d3-833b-450f-9b4a-49052db82d3c\"}"],"class":"WebHookWorker","jid":"6290e47940e7e0e8b641c719","created_at":"2026-09-03T10:33:03.486Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-f326edf50be84ce9","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ec2f98b348feeb6a7bc03b9de60e3b3b0f4efa8e8332caf4d7bb45e4ed523379","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:03.492Z","job_size_bytes":1751,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-6290e47940e7e0e8b641c719: start","job_status":"start","queue_duration_s":3.480635,"scheduling_latency_s":3.480671} gitlab # [ 412.349137] nixbot[3458]: INFO: ::ffff:127.0.0.1:57114 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 412.393351] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:07.263Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"b8db84d3-833b-450f-9b4a-49052db82d3c\"}"],"class":"WebHookWorker","jid":"6290e47940e7e0e8b641c719","created_at":"2026-09-03T10:33:03.486Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-f326edf50be84ce9","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ec2f98b348feeb6a7bc03b9de60e3b3b0f4efa8e8332caf4d7bb45e4ed523379","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:03.492Z","job_size_bytes":1751,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-6290e47940e7e0e8b641c719: done: 0.290594 sec","job_status":"done","queue_duration_s":3.480635,"scheduling_latency_s":3.480671,"redis_calls":19,"redis_duration_s":0.007483,"redis_read_bytes":32,"redis_write_bytes":5366,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001806,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000861,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003135,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001681,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09046116000001803,"cpu_s":0.170081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00091182,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.290594,"completed_at":"2026-09-03T10:33:07.263Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005182,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 412.514866] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:07.267Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d6d0cc7bc7e68216c197527f","created_at":"2026-09-03T10:33:03.743Z","trace_propagation_headers":{"sentry-trace":"0f6485e5b71a4de690e6e0fb50f3285b-d9f6eeda7c064ca9","baggage":"sentry-trace_id=0f6485e5b71a4de690e6e0fb50f3285b,sentry-release=Unknown"},"correlation_id":"01M1KD6080S49E2DXHY8FE7BYJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5d76e557cbc7645e0403ef46","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:03.748Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d6d0cc7bc7e68216c197527f: start","job_status":"start","queue_duration_s":3.51911,"scheduling_latency_s":3.519156} gitlab # [ 412.541633] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:07.369Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"d6d0cc7bc7e68216c197527f","created_at":"2026-09-03T10:33:03.743Z","trace_propagation_headers":{"sentry-trace":"0f6485e5b71a4de690e6e0fb50f3285b-d9f6eeda7c064ca9","baggage":"sentry-trace_id=0f6485e5b71a4de690e6e0fb50f3285b,sentry-release=Unknown"},"correlation_id":"01M1KD6080S49E2DXHY8FE7BYJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"5d76e557cbc7645e0403ef46","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:03.748Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-d6d0cc7bc7e68216c197527f: done: 0.101889 sec","job_status":"done","queue_duration_s":3.51911,"scheduling_latency_s":3.519156,"gitaly_calls":1,"gitaly_duration_s":0.018978,"redis_calls":12,"redis_duration_s":0.008843,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001953,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001444,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005446,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.053132,"duration_s":0.101889,"completed_at":"2026-09-03T10:33:07.369Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012463,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 412.591649] gitaly[920]: time="2026-09-03T10:33:07.335Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ diskcache=e6595f27-70f7-435d-88f9-33c192e5297c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-03T16:33:07.320" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:07.320" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.601365] gitaly[920]: time="2026-09-03T10:33:07.335Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-09-03T16:33:07.320" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:07.320" grpc.time_ms=14.573 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.614342] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:07.372Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"6687fb4054e4b15195ebc850","created_at":"2026-09-03T10:33:03.960Z","trace_propagation_headers":{"sentry-trace":"0f6485e5b71a4de690e6e0fb50f3285b-d9f6eeda7c064ca9","baggage":"sentry-trace_id=0f6485e5b71a4de690e6e0fb50f3285b,sentry-release=Unknown"},"correlation_id":"01M1KD6080S49E2DXHY8FE7BYJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4d0ac3274c613c02223f7cd6df39c07fb4b1597343ac4bde3caacf96100df671","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:03.965Z","job_size_bytes":467,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-6687fb4054e4b15195ebc850: start","job_status":"start","queue_duration_s":3.406794,"scheduling_latency_s":3.406827} gitlab # [ 412.631779] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:07 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 163 gitlab # [ 412.634093] gitaly[920]: time="2026-09-03T10:33:07.412Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:37.310" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:07.411" grpc.time_ms=1.401 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.647476] gitaly[920]: time="2026-09-03T10:33:07.427Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-03T10:33:17.005" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:07.416" grpc.time_ms=11.029 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.660311] gitaly[920]: time="2026-09-03T10:33:07.432Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD8NY5VTQP4GMV8P5RDMRW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:07.418" grpc.time_ms=13.957 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 412.673268] gitlab-workhorse[817]: time="2026-09-03T10:33:07Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 412.675049] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:07 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 92 gitlab # [ 412.676969] gitaly[920]: time="2026-09-03T10:33:07.483Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-03T10:33:37.380" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:07.481" grpc.time_ms=1.862 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.689402] gitaly[920]: time="2026-09-03T10:33:07.493Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=3 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-09-03T10:33:37.387" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:07.488" grpc.time_ms=5.478 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.704902] gitaly[920]: time="2026-09-03T10:33:07.527Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8P3BJX7JRHV06Q1MBWKT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:07.513" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 412.714948] nixbot[3458]: {"ts": "2026-09-03T10:33:07.572Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 412.717483] gitaly[920]: time="2026-09-03T10:33:07.527Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8P3BJX7JRHV06Q1MBWKT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:07.513" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 412.730670] gitaly[920]: time="2026-09-03T10:33:07.529Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8P3BJX7JRHV06Q1MBWKT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:07.513" grpc.time_ms=14.019 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 412.744678] gitaly[920]: time="2026-09-03T10:33:07.553Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=5 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:17.123" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:07.533" grpc.time_ms=19.257 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.788852] gitaly[920]: time="2026-09-03T10:33:07.660Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8P837BDS2RVF6VBB8SYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:37.058" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:07.659" grpc.time_ms=0.883 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.884589] gitaly[920]: time="2026-09-03T10:33:07.755Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD8P837BDS2RVF6VBB8SYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:17.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:07.740" grpc.time_ms=15.536 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.955752] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:07 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 238 gitlab # [ 412.963752] nixbot[3458]: {"ts": "2026-09-03T10:33:07.828Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 \"HTTP/1.1 201 Created\""} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.05 seconds) gitlab # [ 413.081978] gitaly[920]: time="2026-09-03T10:33:07.952Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8PFR1RRCE575ES26G2C9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:37.849" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:07.950" grpc.time_ms=1.246 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.120321] nixbot[3458]: INFO: ::ffff:127.0.0.1:57126 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab # [ 413.230360] gitaly[920]: time="2026-09-03T10:33:08.101Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M1KD8PFR1RRCE575ES26G2C9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:18.053" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:08.084" grpc.time_ms=16.967 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.358979] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 397 gitlab # [ 413.367408] nixbot[3458]: {"ts": "2026-09-03T10:33:08.232Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 \"HTTP/1.1 201 Created\""} gitlab # [ 413.376315] gitaly[920]: time="2026-09-03T10:33:08.236Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-09-03T10:33:38.118" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:08.218" grpc.time_ms=18.213 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.411722] gitaly[920]: time="2026-09-03T10:33:08.252Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1KD6080S49E2DXHY8FE7BYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-09-03T10:33:38.141" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:08.241" grpc.time_ms=10.897 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.437501] sidekiq-cluster[3415]: {"severity":"WARN","time":"2026-09-03T10:33:08.270Z","class":"CreatePipelineWorker","correlation_id":"01M1KD6080S49E2DXHY8FE7BYJ","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"9e55ecafd40c59105acc0d514213c786ac0b6e00","after":"800a76504cdb0e3a9d9162945e09f3675c861f1a","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"800a76504cdb0e3a9d9162945e09f3675c861f1a","ref":"refs/heads/master"},"retry":0} gitlab # [ 413.450336] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.277Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"6687fb4054e4b15195ebc850","created_at":"2026-09-03T10:33:03.960Z","trace_propagation_headers":{"sentry-trace":"0f6485e5b71a4de690e6e0fb50f3285b-d9f6eeda7c064ca9","baggage":"sentry-trace_id=0f6485e5b71a4de690e6e0fb50f3285b,sentry-release=Unknown"},"correlation_id":"01M1KD6080S49E2DXHY8FE7BYJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4d0ac3274c613c02223f7cd6df39c07fb4b1597343ac4bde3caacf96100df671","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:03.965Z","job_size_bytes":467,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-6687fb4054e4b15195ebc850: done: 0.904945 sec","job_status":"done","queue_duration_s":3.406794,"scheduling_latency_s":3.406827,"gitaly_calls":7,"gitaly_duration_s":0.094285,"redis_calls":33,"redis_duration_s":0.006554,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000878,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00147,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003271,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.784384,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.904945,"completed_at":"2026-09-03T10:33:08.276Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033296,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 413.516920] nixbot[3458]: INFO: ::ffff:127.0.0.1:57130 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 413.518289] gitaly[920]: time="2026-09-03T10:33:08.337Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8PWNT2222ZHFFWCKG65B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:38.236" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:08.336" grpc.time_ms=0.726 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.531178] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.278Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"77a8db37-23a1-49ca-9d09-96aed5762813\"}"],"class":"WebHookWorker","jid":"3b657def5b8163d146300b31","created_at":"2026-09-03T10:33:03.992Z","trace_propagation_headers":{"sentry-trace":"0f6485e5b71a4de690e6e0fb50f3285b-d9f6eeda7c064ca9","baggage":"sentry-trace_id=0f6485e5b71a4de690e6e0fb50f3285b,sentry-release=Unknown"},"correlation_id":"01M1KD6080S49E2DXHY8FE7BYJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2780d2734a0f8d22ffbaaab6fe85a8739d79b83ebcd09ebc2e6702902b7f4d9a","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:03.995Z","job_size_bytes":1749,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3b657def5b8163d146300b31: start","job_status":"start","queue_duration_s":4.282875,"scheduling_latency_s":4.282898} gitlab # [ 413.548385] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.344Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"77a8db37-23a1-49ca-9d09-96aed5762813\"}"],"class":"WebHookWorker","jid":"3b657def5b8163d146300b31","created_at":"2026-09-03T10:33:03.992Z","trace_propagation_headers":{"sentry-trace":"0f6485e5b71a4de690e6e0fb50f3285b-d9f6eeda7c064ca9","baggage":"sentry-trace_id=0f6485e5b71a4de690e6e0fb50f3285b,sentry-release=Unknown"},"correlation_id":"01M1KD6080S49E2DXHY8FE7BYJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2780d2734a0f8d22ffbaaab6fe85a8739d79b83ebcd09ebc2e6702902b7f4d9a","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:03.995Z","job_size_bytes":1749,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-3b657def5b8163d146300b31: done: 0.066184 sec","job_status":"done","queue_duration_s":4.282875,"scheduling_latency_s":4.282898,"redis_calls":14,"redis_duration_s":0.003987,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.001293,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001774,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.013262220000001435,"cpu_s":0.039966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.066184,"completed_at":"2026-09-03T10:33:08.344Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 413.594617] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.353Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"503421c2b9bc063d6a9ec182","created_at":"2026-09-03T10:33:04.710Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:04.717Z","job_size_bytes":23,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-503421c2b9bc063d6a9ec182: start","job_status":"start","queue_duration_s":3.635465,"scheduling_latency_s":3.635514} gitlab # [ 413.611025] gitaly[920]: time="2026-09-03T10:33:08.436Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=4 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD8PWNT2222ZHFFWCKG65B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:18.069" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:08.420" grpc.time_ms=16.586 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.624359] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 111 gitlab # [ 413.626419] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.468Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"503421c2b9bc063d6a9ec182","created_at":"2026-09-03T10:33:04.710Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:04.717Z","job_size_bytes":23,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-503421c2b9bc063d6a9ec182: done: 0.115847 sec","job_status":"done","queue_duration_s":3.635465,"scheduling_latency_s":3.635514,"redis_calls":10,"redis_duration_s":0.00902,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001074,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004516,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00343,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07672,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048112,"duration_s":0.115847,"completed_at":"2026-09-03T10:33:08.468Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018819,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 413.674852] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.470Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"95467383c5dc6cc0ec64e0d5","created_at":"2026-09-03T10:33:04.902Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:04.913Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-95467383c5dc6cc0ec64e0d5: start","job_status":"start","queue_duration_s":3.557402,"scheduling_latency_s":3.557427} gitlab # [ 413.691170] gitaly[920]: time="2026-09-03T10:33:08.468Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD8Q05C0Y2YANNGQG7452A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=196 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:08.452" grpc.time_ms=15.84 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 413.704302] nixbot[3458]: {"ts": "2026-09-03T10:33:08.528Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 \"HTTP/1.1 201 Created\""} gitlab # [ 413.707364] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:08 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/9e55ecafd40c59105acc0d514213c786ac0b6e00 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 280 gitlab # [ 413.709953] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.509Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"95467383c5dc6cc0ec64e0d5","created_at":"2026-09-03T10:33:04.902Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:04.913Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-95467383c5dc6cc0ec64e0d5: done: 0.039339 sec","job_status":"done","queue_duration_s":3.557402,"scheduling_latency_s":3.557427,"redis_calls":10,"redis_duration_s":0.00157,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000337,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000344,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030734,"duration_s":0.039339,"completed_at":"2026-09-03T10:33:08.509Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004896,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 413.754054] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.511Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"074d8e2c9bd87c7d456729bc","created_at":"2026-09-03T10:33:04.941Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:04.954Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-074d8e2c9bd87c7d456729bc: start","job_status":"start","queue_duration_s":3.557013,"scheduling_latency_s":3.557036} gitlab # [ 413.769844] gitaly[920]: time="2026-09-03T10:33:08.577Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8Q3Q8VAT3HTRR909WNK9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:08.564" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 413.779985] gitlab-workhorse[817]: time="2026-09-03T10:33:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 413.781816] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 107 gitlab # [ 413.783689] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.553Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"074d8e2c9bd87c7d456729bc","created_at":"2026-09-03T10:33:04.941Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:04.954Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-074d8e2c9bd87c7d456729bc: done: 0.042017 sec","job_status":"done","queue_duration_s":3.557013,"scheduling_latency_s":3.557036,"redis_calls":10,"redis_duration_s":0.001532,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000283,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000317,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026578,"duration_s":0.042017,"completed_at":"2026-09-03T10:33:08.553Z","load_balancing_strategy":"primary","db_duration_s":0.005331,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 413.827266] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.554Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"0c1f64cdde3d538a9e473c8c","created_at":"2026-09-03T10:33:04.986Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:04.996Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-0c1f64cdde3d538a9e473c8c: start","job_status":"start","queue_duration_s":3.557726,"scheduling_latency_s":3.557747} gitlab # [ 413.842688] gitaly[920]: time="2026-09-03T10:33:08.578Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8Q3Q8VAT3HTRR909WNK9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:08.564" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 413.856222] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.607Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"0c1f64cdde3d538a9e473c8c","created_at":"2026-09-03T10:33:04.986Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:04.996Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-0c1f64cdde3d538a9e473c8c: done: 0.053223 sec","job_status":"done","queue_duration_s":3.557726,"scheduling_latency_s":3.557747,"redis_calls":13,"redis_duration_s":0.005013,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000312,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003962,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000357,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000382,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056052,"duration_s":0.053223,"completed_at":"2026-09-03T10:33:08.607Z","load_balancing_strategy":"primary","db_duration_s":0.006768,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 413.902420] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.610Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a30cdd2e1fb9be9ee9ce3ed0","created_at":"2026-09-03T10:33:04.998Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.011Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a30cdd2e1fb9be9ee9ce3ed0: start","job_status":"start","queue_duration_s":3.599532,"scheduling_latency_s":3.599566} gitlab # [ 413.928952] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 111 gitlab # [ 413.931832] gitaly[920]: time="2026-09-03T10:33:08.578Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8Q3Q8VAT3HTRR909WNK9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:08.564" grpc.time_ms=13.526 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 413.951970] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.684Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"a30cdd2e1fb9be9ee9ce3ed0","created_at":"2026-09-03T10:33:04.998Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.011Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-a30cdd2e1fb9be9ee9ce3ed0: done: 0.073525 sec","job_status":"done","queue_duration_s":3.599532,"scheduling_latency_s":3.599566,"redis_calls":10,"redis_duration_s":0.005555,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001526,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002479,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00155,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036674,"duration_s":0.073525,"completed_at":"2026-09-03T10:33:08.683Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011681,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 413.998729] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.686Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"951b6964254b2535e056f3b9","created_at":"2026-09-03T10:33:05.012Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.022Z","job_size_bytes":19,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-951b6964254b2535e056f3b9: start","job_status":"start","queue_duration_s":3.663676,"scheduling_latency_s":3.663709} gitlab # [ 414.015049] gitlab-workhorse[817]: time="2026-09-03T10:33:08Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 414.017013] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:08 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 90 gitlab # [ 414.018886] gitaly[920]: time="2026-09-03T10:33:08.724Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M1KD8Q84PJ76XZJCVKKKSG6E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:08.712" grpc.time_ms=11.916 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 414.032693] gitaly[920]: time="2026-09-03T10:33:08.816Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8QBQMVKJNAWC71X7W5YB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:08.807" pid=920 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 414.042872] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.750Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"951b6964254b2535e056f3b9","created_at":"2026-09-03T10:33:05.012Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.022Z","job_size_bytes":19,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-951b6964254b2535e056f3b9: done: 0.064787 sec","job_status":"done","queue_duration_s":3.663676,"scheduling_latency_s":3.663709,"redis_calls":11,"redis_duration_s":0.00685,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00064,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005609,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000601,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00093136,"duration_s":0.064787,"completed_at":"2026-09-03T10:33:08.750Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006707,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 414.088187] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.755Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"004c8921220fe1c26e5eb0e9","created_at":"2026-09-03T10:33:05.027Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.037Z","job_size_bytes":66,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-004c8921220fe1c26e5eb0e9: start","job_status":"start","queue_duration_s":3.718031,"scheduling_latency_s":3.718071} gitlab # [ 414.105159] gitaly[920]: time="2026-09-03T10:33:08.816Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8QBQMVKJNAWC71X7W5YB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:08.807" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 414.117503] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:08 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 88 gitlab # [ 414.119583] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.824Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"004c8921220fe1c26e5eb0e9","created_at":"2026-09-03T10:33:05.027Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.037Z","job_size_bytes":66,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-004c8921220fe1c26e5eb0e9: done: 0.068611 sec","job_status":"done","queue_duration_s":3.718031,"scheduling_latency_s":3.718071,"redis_calls":10,"redis_duration_s":0.005728,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001517,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00356,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000651,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048988,"duration_s":0.068611,"completed_at":"2026-09-03T10:33:08.823Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012309,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 414.164430] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.828Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"8486cba65907beac9786a658","created_at":"2026-09-03T10:33:05.039Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.046Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8486cba65907beac9786a658: start","job_status":"start","queue_duration_s":3.782334,"scheduling_latency_s":3.7824} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.09 seconds) gitlab # [ 414.180425] gitaly[920]: time="2026-09-03T10:33:08.817Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8QBQMVKJNAWC71X7W5YB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:08.807" grpc.time_ms=9.423 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 414.194637] nixbot[3458]: INFO: ::ffff:127.0.0.1:57138 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab # [ 414.196625] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.921Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"8486cba65907beac9786a658","created_at":"2026-09-03T10:33:05.039Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.046Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8486cba65907beac9786a658: done: 0.093216 sec","job_status":"done","queue_duration_s":3.782334,"scheduling_latency_s":3.7824,"redis_calls":10,"redis_duration_s":0.011438,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003906,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006319,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001213,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00122988,"duration_s":0.093216,"completed_at":"2026-09-03T10:33:08.921Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00956,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 414.241393] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:08.924Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f8aa706c00b840e93ca2975a","created_at":"2026-09-03T10:33:05.056Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.063Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f8aa706c00b840e93ca2975a: start","job_status":"start","queue_duration_s":3.860661,"scheduling_latency_s":3.860693} gitlab # [ 414.257497] gitaly[920]: time="2026-09-03T10:33:08.959Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M1KD8QG8G2KR79WP2MVY3FAJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:08.948" grpc.time_ms=10.897 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 414.270683] gitaly[920]: time="2026-09-03T10:33:09.068Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8QK22VAQY7XDR9V3FBGY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:09.043" pid=920 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 414.282026] gitlab-workhorse[817]: time="2026-09-03T10:33:09Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 414.283787] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:09 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 107 gitlab # [ 414.285752] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.006Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"f8aa706c00b840e93ca2975a","created_at":"2026-09-03T10:33:05.056Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.063Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-f8aa706c00b840e93ca2975a: done: 0.082837 sec","job_status":"done","queue_duration_s":3.860661,"scheduling_latency_s":3.860693,"redis_calls":10,"redis_duration_s":0.00619,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000488,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004027,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001675,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00107208,"duration_s":0.082837,"completed_at":"2026-09-03T10:33:09.006Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023523,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 414.330009] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.009Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"06208bf746d23d4808e68eea","created_at":"2026-09-03T10:33:05.064Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.072Z","job_size_bytes":6,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-06208bf746d23d4808e68eea: start","job_status":"start","queue_duration_s":3.93742,"scheduling_latency_s":3.937466} gitlab # [ 414.345543] gitaly[920]: time="2026-09-03T10:33:09.068Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8QK22VAQY7XDR9V3FBGY grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:09.043" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 414.359494] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.046Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"06208bf746d23d4808e68eea","created_at":"2026-09-03T10:33:05.064Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.072Z","job_size_bytes":6,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-06208bf746d23d4808e68eea: done: 0.036968 sec","job_status":"done","queue_duration_s":3.93742,"scheduling_latency_s":3.937466,"redis_calls":10,"redis_duration_s":0.002686,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000394,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000548,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052016,"duration_s":0.036968,"completed_at":"2026-09-03T10:33:09.046Z","load_balancing_strategy":"primary","db_duration_s":0.006988,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 414.403462] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.048Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"18e5bce7a371a2a4a9f6850e","created_at":"2026-09-03T10:33:05.073Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.078Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-18e5bce7a371a2a4a9f6850e: start","job_status":"start","queue_duration_s":3.969714,"scheduling_latency_s":3.969732} gitlab # [ 414.418885] gitaly[920]: time="2026-09-03T10:33:09.069Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=4 command.system_time_ms=7 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8QK22VAQY7XDR9V3FBGY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:09.043" grpc.time_ms=25.28 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 414.433406] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.101Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"18e5bce7a371a2a4a9f6850e","created_at":"2026-09-03T10:33:05.073Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.078Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-18e5bce7a371a2a4a9f6850e: done: 0.052887 sec","job_status":"done","queue_duration_s":3.969714,"scheduling_latency_s":3.969732,"redis_calls":10,"redis_duration_s":0.002303,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00031,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001296,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000697,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038298,"duration_s":0.052887,"completed_at":"2026-09-03T10:33:09.101Z","load_balancing_strategy":"primary","db_duration_s":0.019074,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 414.476193] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.102Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"00d6d3e56280762fd9b6b743","created_at":"2026-09-03T10:33:05.087Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.093Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-00d6d3e56280762fd9b6b743: start","job_status":"start","queue_duration_s":4.00955,"scheduling_latency_s":4.009568} gitlab # [ 414.493139] gitaly[920]: time="2026-09-03T10:33:09.188Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8QR4GC2PDKB3ZQC2MACD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:39.084" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:09.184" grpc.time_ms=4.015 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.505734] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.188Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"00d6d3e56280762fd9b6b743","created_at":"2026-09-03T10:33:05.087Z","trace_propagation_headers":{"sentry-trace":"8eac1f976a4241b69c64cef3e8a77800-8544dcca11994b4e","baggage":"sentry-trace_id=8eac1f976a4241b69c64cef3e8a77800,sentry-release=Unknown"},"correlation_id":"01M1KD60TTMJ5PSW6W66G8RH8X","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.093Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-00d6d3e56280762fd9b6b743: done: 0.085608 sec","job_status":"done","queue_duration_s":4.00955,"scheduling_latency_s":4.009568,"redis_calls":14,"redis_duration_s":0.007902,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000956,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001961,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004985,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.050846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052498,"duration_s":0.085608,"completed_at":"2026-09-03T10:33:09.188Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021057,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 414.550024] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.193Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ec8db6f4bbfe497d983cb7f2","created_at":"2026-09-03T10:33:05.361Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-2ea9842d667c4bff","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.369Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ec8db6f4bbfe497d983cb7f2: start","job_status":"start","queue_duration_s":3.82406,"scheduling_latency_s":3.824081} gitlab # [ 414.566077] gitaly[920]: time="2026-09-03T10:33:09.217Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=589 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=5 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD8QR4GC2PDKB3ZQC2MACD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-03T10:33:39.101" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:09.201" grpc.time_ms=15.764 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.579967] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.255Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"ec8db6f4bbfe497d983cb7f2","created_at":"2026-09-03T10:33:05.361Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-2ea9842d667c4bff","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:05.369Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-ec8db6f4bbfe497d983cb7f2: done: 0.062121 sec","job_status":"done","queue_duration_s":3.82406,"scheduling_latency_s":3.824081,"redis_calls":19,"redis_duration_s":0.003777,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000831,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.00066,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001581,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000705,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01098942,"duration_s":0.062121,"completed_at":"2026-09-03T10:33:09.255Z","load_balancing_strategy":"primary","db_duration_s":0.009142,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 414.625755] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.257Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","6290e47940e7e0e8b641c719"],"class":"WebHooks::LogExecutionWorker","jid":"0cf3091aa1c424783285af06","created_at":"2026-09-03T10:33:07.225Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-58aeeca9289f4d5e","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:52fe8cbd6a2c3d0efc14845785489cc1c92cdd32c81a8d30b00e4e7717b8f0c8","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:07.239Z","job_size_bytes":2591,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-0cf3091aa1c424783285af06: start","job_status":"start","queue_duration_s":2.017419,"scheduling_latency_s":2.017436} gitlab # [ 414.642765] gitaly[920]: time="2026-09-03T10:33:09.246Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=2 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M1KD8QR4GC2PDKB3ZQC2MACD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:19.234" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:09.234" grpc.time_ms=11.653 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.656257] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 359 gitlab # [ 414.658680] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.309Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","6290e47940e7e0e8b641c719"],"class":"WebHooks::LogExecutionWorker","jid":"0cf3091aa1c424783285af06","created_at":"2026-09-03T10:33:07.225Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-58aeeca9289f4d5e","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:52fe8cbd6a2c3d0efc14845785489cc1c92cdd32c81a8d30b00e4e7717b8f0c8","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:07.239Z","job_size_bytes":2591,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-0cf3091aa1c424783285af06: done: 0.052578 sec","job_status":"done","queue_duration_s":2.017419,"scheduling_latency_s":2.017436,"redis_calls":10,"redis_duration_s":0.002078,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000346,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001302,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00043,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030284,"duration_s":0.052578,"completed_at":"2026-09-03T10:33:09.309Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00644,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 414.704062] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.311Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"11600c8ba857ea02f25c8100","created_at":"2026-09-03T10:33:07.801Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-920bc28e851d488f","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:07.806Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-11600c8ba857ea02f25c8100: start","job_status":"start","queue_duration_s":1.504805,"scheduling_latency_s":1.504826} gitlab # [ 414.719429] nixbot[3458]: {"ts": "2026-09-03T10:33:09.482Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/800a76504cdb0e3a9d9162945e09f3675c861f1a \"HTTP/1.1 201 Created\""} gitlab # [ 414.722296] nixbot[3458]: {"ts": "2026-09-03T10:33:09.492Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-800a76504cdb-4"} gitlab # [ 414.724590] gitaly[920]: time="2026-09-03T10:33:09.280Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8QR4GC2PDKB3ZQC2MACD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-03T10:33:19.280" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:33:09.280" grpc.time_ms=0.209 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.735301] gitaly[920]: time="2026-09-03T10:33:09.301Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8QR4GC2PDKB3ZQC2MACD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-03T10:33:19.288" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:09.288" grpc.time_ms=13.005 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.748750] gitaly[920]: time="2026-09-03T10:33:09.343Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD8QR4GC2PDKB3ZQC2MACD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:33:09.342" grpc.time_ms=0.517 pid=920 span.kind=server system=grpc gitlab # [ 414.758331] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.606Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"11600c8ba857ea02f25c8100","created_at":"2026-09-03T10:33:07.801Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-920bc28e851d488f","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:07.806Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3415,"job_status":"rescheduled","message":"PipelineProcessWorker JID-11600c8ba857ea02f25c8100: rescheduled"} gitlab # [ 414.773199] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.614Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"11600c8ba857ea02f25c8100","created_at":"2026-09-03T10:33:07.801Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-920bc28e851d488f","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:07.806Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-11600c8ba857ea02f25c8100: done: 0.303449 sec","job_status":"done","queue_duration_s":1.504805,"scheduling_latency_s":1.504826,"gitaly_calls":3,"gitaly_duration_s":0.102337,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.016553000000000002,"redis_read_bytes":151,"redis_write_bytes":18011,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000576,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.003943,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003195,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12310,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.005368,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000305,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001314,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.001276,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.008,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.157151,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.2550966,"duration_s":0.303449,"completed_at":"2026-09-03T10:33:09.614Z","load_balancing_strategy":"primary","db_duration_s":0.034693,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 414.824144] nixbot[3458]: {"ts": "2026-09-03T10:33:09.629Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-800a76504cdb-4", "argv0": "bwrap"} gitlab # [ 414.826439] gitaly[920]: time="2026-09-03T10:33:09.376Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD8QR4GC2PDKB3ZQC2MACD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:33:09.376" grpc.time_ms=0.582 pid=920 span.kind=server system=grpc gitlab # [ 414.835961] gitaly[920]: time="2026-09-03T10:33:09.384Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8QR4GC2PDKB3ZQC2MACD diskcache=483c89fc-05af-4b55-8942-b1860f5ccfb6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-03T10:33:19.004" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:33:09.305" pid=920 ref=refs/keep-around/800a76504cdb0e3a9d9162945e09f3675c861f1a remote_ip="2001:db8:1::1" revision=800a76504cdb0e3a9d9162945e09f3675c861f1a span.kind=server system=grpc username=root gitlab # [ 414.847305] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.616Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3b657def5b8163d146300b31"],"class":"WebHooks::LogExecutionWorker","jid":"a09b89198afc475d1198fa88","created_at":"2026-09-03T10:33:08.322Z","trace_propagation_headers":{"sentry-trace":"0f6485e5b71a4de690e6e0fb50f3285b-1ff96c8baa224cb9","baggage":"sentry-trace_id=0f6485e5b71a4de690e6e0fb50f3285b,sentry-release=Unknown"},"correlation_id":"01M1KD6080S49E2DXHY8FE7BYJ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0aa060be28324167e106c985ed6fb46254c7f2a9fa4c071acc33ac8943e7824f","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:08.328Z","job_size_bytes":2592,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a09b89198afc475d1198fa88: start","job_status":"start","queue_duration_s":1.288369,"scheduling_latency_s":1.288395} gitlab # [ 414.864127] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.648Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","3b657def5b8163d146300b31"],"class":"WebHooks::LogExecutionWorker","jid":"a09b89198afc475d1198fa88","created_at":"2026-09-03T10:33:08.322Z","trace_propagation_headers":{"sentry-trace":"0f6485e5b71a4de690e6e0fb50f3285b-1ff96c8baa224cb9","baggage":"sentry-trace_id=0f6485e5b71a4de690e6e0fb50f3285b,sentry-release=Unknown"},"correlation_id":"01M1KD6080S49E2DXHY8FE7BYJ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0aa060be28324167e106c985ed6fb46254c7f2a9fa4c071acc33ac8943e7824f","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:08.328Z","job_size_bytes":2592,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-a09b89198afc475d1198fa88: done: 0.032394 sec","job_status":"done","queue_duration_s":1.288369,"scheduling_latency_s":1.288395,"redis_calls":7,"redis_duration_s":0.001575,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001109,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032394,"completed_at":"2026-09-03T10:33:09.648Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004939,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 414.908305] gitaly[920]: time="2026-09-03T10:33:09.385Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=69 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5096 command.oublock=8 command.real_time_ms=72 command.spawn_token_fork_ms=1 command.system_time_ms=40 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8QR4GC2PDKB3ZQC2MACD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-03T10:33:19.004" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-03T10:33:09.305" grpc.time_ms=79.475 pid=920 ref=refs/keep-around/800a76504cdb0e3a9d9162945e09f3675c861f1a remote_ip="2001:db8:1::1" revision=800a76504cdb0e3a9d9162945e09f3675c861f1a span.kind=server system=grpc username=root gitlab # [ 414.923162] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.650Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"41cb17b4c2e69ba6bf7eff4f","created_at":"2026-09-03T10:33:09.237Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-2598439ada0d480c","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.244Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-41cb17b4c2e69ba6bf7eff4f: start","job_status":"start","queue_duration_s":0.4063,"scheduling_latency_s":0.406323} gitlab # [ 414.940133] gitaly[920]: time="2026-09-03T10:33:09.389Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8QR4GC2PDKB3ZQC2MACD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:39.288" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:09.388" grpc.time_ms=0.682 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.952688] gitaly[920]: time="2026-09-03T10:33:09.418Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD8P837BDS2RVF6VBB8SYN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:33:09.418" grpc.time_ms=0.576 pid=920 span.kind=server system=grpc gitlab # [ 414.962178] gitaly[920]: time="2026-09-03T10:33:09.447Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD8P837BDS2RVF6VBB8SYN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:33:09.446" grpc.time_ms=1.084 pid=920 span.kind=server system=grpc gitlab # [ 414.971631] gitaly[920]: time="2026-09-03T10:33:09.478Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD8P837BDS2RVF6VBB8SYN grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:33:09.478" grpc.time_ms=0.353 pid=920 span.kind=server system=grpc gitlab # [ 414.981244] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.829Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"41cb17b4c2e69ba6bf7eff4f","created_at":"2026-09-03T10:33:09.237Z","trace_propagation_headers":{"sentry-trace":"93fb1245f3634e2fa385ca7cd5f72470-2598439ada0d480c","baggage":"sentry-trace_id=93fb1245f3634e2fa385ca7cd5f72470,sentry-release=Unknown"},"correlation_id":"01M1KD5SN2R0HA4XT4ZG4ATXNE","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.244Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-41cb17b4c2e69ba6bf7eff4f: done: 0.178875 sec","job_status":"done","queue_duration_s":0.4063,"scheduling_latency_s":0.406323,"redis_calls":11,"redis_duration_s":0.0054410000000000005,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000522,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004257,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000662,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.132357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00100732,"duration_s":0.178875,"completed_at":"2026-09-03T10:33:09.829Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039575,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.026035] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.832Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d27939af03b1bc435c3f1832","created_at":"2026-09-03T10:33:09.384Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.388Z","job_size_bytes":23,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d27939af03b1bc435c3f1832: start","job_status":"start","queue_duration_s":0.444124,"scheduling_latency_s":0.444157} gitlab # [ 415.042894] gitaly[920]: time="2026-09-03T10:33:09.488Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8P837BDS2RVF6VBB8SYN diskcache=a7ca9850-66f5-48f3-9253-50ced6dc8ece grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-03T10:33:39.295" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:09.395" pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.052675] gitaly[920]: time="2026-09-03T10:33:09.488Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=80 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7140 command.oublock=0 command.real_time_ms=88 command.spawn_token_fork_ms=0 command.system_time_ms=42 command.user_time_ms=38 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8P837BDS2RVF6VBB8SYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-09-03T10:33:39.295" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:09.395" grpc.time_ms=92.833 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.065766] nix-daemon[3684]: accepted connection from pid 4327, user nixbot gitlab # [ 415.066750] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.899Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"d27939af03b1bc435c3f1832","created_at":"2026-09-03T10:33:09.384Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.388Z","job_size_bytes":23,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-d27939af03b1bc435c3f1832: done: 0.067089 sec","job_status":"done","queue_duration_s":0.444124,"scheduling_latency_s":0.444157,"redis_calls":7,"redis_duration_s":0.003299,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001854,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001445,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.067089,"completed_at":"2026-09-03T10:33:09.899Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012699,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 415.109894] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.902Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"030bf800015836052bdd189f","created_at":"2026-09-03T10:33:09.391Z","trace_propagation_headers":{"sentry-trace":"b644b4efc7cf43aba9e63c8bd1a0f13a-fa5524d686af495d","baggage":"sentry-trace_id=b644b4efc7cf43aba9e63c8bd1a0f13a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD8QR4GC2PDKB3ZQC2MACD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.396Z","job_size_bytes":65,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-030bf800015836052bdd189f: start","job_status":"start","queue_duration_s":0.505165,"scheduling_latency_s":0.505189} gitlab # [ 415.126556] gitaly[920]: time="2026-09-03T10:33:09.548Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD8P837BDS2RVF6VBB8SYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-03T10:33:39.446" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:09.547" grpc.time_ms=0.88 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.139251] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.944Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"030bf800015836052bdd189f","created_at":"2026-09-03T10:33:09.391Z","trace_propagation_headers":{"sentry-trace":"b644b4efc7cf43aba9e63c8bd1a0f13a-fa5524d686af495d","baggage":"sentry-trace_id=b644b4efc7cf43aba9e63c8bd1a0f13a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD8QR4GC2PDKB3ZQC2MACD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.396Z","job_size_bytes":65,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-030bf800015836052bdd189f: done: 0.042144 sec","job_status":"done","queue_duration_s":0.505165,"scheduling_latency_s":0.505189,"redis_calls":7,"redis_duration_s":0.002237,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001542,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000695,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042144,"completed_at":"2026-09-03T10:33:09.944Z","load_balancing_strategy":"primary","db_duration_s":0.007477,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a' gitlab # [ 415.181741] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:09.946Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"eb3944bcb145ac6ca2e5121f","created_at":"2026-09-03T10:33:09.398Z","trace_propagation_headers":{"sentry-trace":"b644b4efc7cf43aba9e63c8bd1a0f13a-fa5524d686af495d","baggage":"sentry-trace_id=b644b4efc7cf43aba9e63c8bd1a0f13a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD8QR4GC2PDKB3ZQC2MACD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.402Z","job_size_bytes":65,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-eb3944bcb145ac6ca2e5121f: start","job_status":"start","queue_duration_s":0.543473,"scheduling_latency_s":0.543493} gitlab # [ 415.198167] gitaly[920]: time="2026-09-03T10:33:09.596Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8P837BDS2RVF6VBB8SYN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:39.494" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:09.594" grpc.time_ms=0.867 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.209792] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.027Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"eb3944bcb145ac6ca2e5121f","created_at":"2026-09-03T10:33:09.398Z","trace_propagation_headers":{"sentry-trace":"b644b4efc7cf43aba9e63c8bd1a0f13a-fa5524d686af495d","baggage":"sentry-trace_id=b644b4efc7cf43aba9e63c8bd1a0f13a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD8QR4GC2PDKB3ZQC2MACD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.402Z","job_size_bytes":65,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-eb3944bcb145ac6ca2e5121f: done: 0.08087 sec","job_status":"done","queue_duration_s":0.543473,"scheduling_latency_s":0.543493,"redis_calls":10,"redis_duration_s":0.0038850000000000004,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002138,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.08087,"completed_at":"2026-09-03T10:33:10.026Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.252481] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.028Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"abd3ab9fc2c42acec8f34af9","created_at":"2026-09-03T10:33:09.464Z","trace_propagation_headers":{"sentry-trace":"b644b4efc7cf43aba9e63c8bd1a0f13a-fa5524d686af495d","baggage":"sentry-trace_id=b644b4efc7cf43aba9e63c8bd1a0f13a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD8QR4GC2PDKB3ZQC2MACD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.467Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-abd3ab9fc2c42acec8f34af9: start","job_status":"start","queue_duration_s":0.561752,"scheduling_latency_s":0.561774} gitlab # [ 415.268055] gitaly[920]: time="2026-09-03T10:33:10.129Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD8QR4GC2PDKB3ZQC2MACD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-03T10:33:40.022" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:10.123" grpc.time_ms=4.34 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.280878] nixbot[3458]: INFO: ::ffff:127.0.0.1:57148 - "GET /api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=800a76504cdb0e3a9d9162945e09f3675c861f1a', in 0.10 seconds) (finished: subtest: push delivers the webhook, in 90.92 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses gitlab # [ 415.335541] gitaly[920]: time="2026-09-03T10:33:10.206Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8QR4GC2PDKB3ZQC2MACD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:40.104" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:10.205" grpc.time_ms=1.421 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.363409] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.233Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"abd3ab9fc2c42acec8f34af9","created_at":"2026-09-03T10:33:09.464Z","trace_propagation_headers":{"sentry-trace":"b644b4efc7cf43aba9e63c8bd1a0f13a-fa5524d686af495d","baggage":"sentry-trace_id=b644b4efc7cf43aba9e63c8bd1a0f13a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD8QR4GC2PDKB3ZQC2MACD","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.467Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-abd3ab9fc2c42acec8f34af9: done: 0.204929 sec","job_status":"done","queue_duration_s":0.561752,"scheduling_latency_s":0.561774,"gitaly_calls":2,"gitaly_duration_s":0.013893,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.010578,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001268,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001876,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000699,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002931,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000405,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000782,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001349,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.003,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.141616,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15474754,"duration_s":0.204929,"completed_at":"2026-09-03T10:33:10.233Z","load_balancing_strategy":"primary","db_duration_s":0.050308,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses, in 0.15 seconds) gitlab # [ 415.423202] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.237Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3ccc128c563dd35a977fa60c","created_at":"2026-09-03T10:33:09.493Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.496Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3ccc128c563dd35a977fa60c: start","job_status":"start","queue_duration_s":0.741362,"scheduling_latency_s":0.741404} gitlab # [ 415.439870] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.292Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"3ccc128c563dd35a977fa60c","created_at":"2026-09-03T10:33:09.493Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.496Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-3ccc128c563dd35a977fa60c: done: 0.054983 sec","job_status":"done","queue_duration_s":0.741362,"scheduling_latency_s":0.741404,"redis_calls":7,"redis_duration_s":0.004218,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003386,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000832,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.054983,"completed_at":"2026-09-03T10:33:10.292Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007465,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.482196] gitaly[920]: time="2026-09-03T10:33:10.257Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8RS879DXN65PD45N58MS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:40.155" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:10.255" grpc.time_ms=1.162 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.495105] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 120 gitlab # [ 415.498043] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.295Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c331b7a121d116d31cf8764c","created_at":"2026-09-03T10:33:09.502Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.505Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c331b7a121d116d31cf8764c: start","job_status":"start","queue_duration_s":0.789535,"scheduling_latency_s":0.789563} gitlab # [ 415.514703] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.336Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"c331b7a121d116d31cf8764c","created_at":"2026-09-03T10:33:09.502Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.505Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-c331b7a121d116d31cf8764c: done: 0.041558 sec","job_status":"done","queue_duration_s":0.789535,"scheduling_latency_s":0.789563,"redis_calls":7,"redis_duration_s":0.002606,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002015,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000591,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041558,"completed_at":"2026-09-03T10:33:10.336Z","load_balancing_strategy":"primary","db_duration_s":0.00576,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.556272] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.339Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"06449306f96dbbcf00f6c270","created_at":"2026-09-03T10:33:09.515Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.518Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-06449306f96dbbcf00f6c270: start","job_status":"start","queue_duration_s":0.82145,"scheduling_latency_s":0.821486} gitlab # [ 415.571317] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.395Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"06449306f96dbbcf00f6c270","created_at":"2026-09-03T10:33:09.515Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.518Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-06449306f96dbbcf00f6c270: done: 0.056091 sec","job_status":"done","queue_duration_s":0.82145,"scheduling_latency_s":0.821486,"redis_calls":10,"redis_duration_s":0.003742,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001914,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001064,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000764,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.039542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056091,"completed_at":"2026-09-03T10:33:10.395Z","load_balancing_strategy":"primary","db_duration_s":0.008932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.613643] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.397Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"80852c56a8dfc3fb5405aae3","created_at":"2026-09-03T10:33:09.518Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.521Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-80852c56a8dfc3fb5405aae3: start","job_status":"start","queue_duration_s":0.876586,"scheduling_latency_s":0.876611} gitlab # [ 415.630091] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.438Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"80852c56a8dfc3fb5405aae3","created_at":"2026-09-03T10:33:09.518Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.521Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-80852c56a8dfc3fb5405aae3: done: 0.04082 sec","job_status":"done","queue_duration_s":0.876586,"scheduling_latency_s":0.876611,"redis_calls":7,"redis_duration_s":0.002345,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000632,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.04082,"completed_at":"2026-09-03T10:33:10.438Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007506,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.672130] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.440Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1b1fceddb90c9205e51ce27a","created_at":"2026-09-03T10:33:09.522Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.524Z","job_size_bytes":19,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1b1fceddb90c9205e51ce27a: start","job_status":"start","queue_duration_s":0.916154,"scheduling_latency_s":0.916177} gitlab # [ 415.688094] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.474Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1b1fceddb90c9205e51ce27a","created_at":"2026-09-03T10:33:09.522Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.524Z","job_size_bytes":19,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1b1fceddb90c9205e51ce27a: done: 0.034165 sec","job_status":"done","queue_duration_s":0.916154,"scheduling_latency_s":0.916177,"redis_calls":8,"redis_duration_s":0.002356,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001854,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000502,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.034165,"completed_at":"2026-09-03T10:33:10.474Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.730580] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.476Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3b5086800c61ea7e9c7f0ad3","created_at":"2026-09-03T10:33:09.525Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.527Z","job_size_bytes":66,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3b5086800c61ea7e9c7f0ad3: start","job_status":"start","queue_duration_s":0.949152,"scheduling_latency_s":0.949172} gitlab # [ 415.747739] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.506Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3b5086800c61ea7e9c7f0ad3","created_at":"2026-09-03T10:33:09.525Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.527Z","job_size_bytes":66,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3b5086800c61ea7e9c7f0ad3: done: 0.029502 sec","job_status":"done","queue_duration_s":0.949152,"scheduling_latency_s":0.949172,"redis_calls":7,"redis_duration_s":0.002257,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029502,"completed_at":"2026-09-03T10:33:10.506Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.790542] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.507Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"28679efb975c7f18c6362b44","created_at":"2026-09-03T10:33:09.528Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.529Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-28679efb975c7f18c6362b44: start","job_status":"start","queue_duration_s":0.977947,"scheduling_latency_s":0.977967} gitlab # [ 415.806400] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.539Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"28679efb975c7f18c6362b44","created_at":"2026-09-03T10:33:09.528Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.529Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-28679efb975c7f18c6362b44: done: 0.031878 sec","job_status":"done","queue_duration_s":0.977947,"scheduling_latency_s":0.977967,"redis_calls":7,"redis_duration_s":0.00209,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001406,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000684,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031878,"completed_at":"2026-09-03T10:33:10.539Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007375,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.848256] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.541Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"dc156810d4b9e41f7070493c","created_at":"2026-09-03T10:33:09.530Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.532Z","job_size_bytes":6,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-dc156810d4b9e41f7070493c: start","job_status":"start","queue_duration_s":1.009203,"scheduling_latency_s":1.009222} gitlab # [ 415.864100] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.557Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"dc156810d4b9e41f7070493c","created_at":"2026-09-03T10:33:09.530Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.532Z","job_size_bytes":6,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-dc156810d4b9e41f7070493c: done: 0.016039 sec","job_status":"done","queue_duration_s":1.009203,"scheduling_latency_s":1.009222,"redis_calls":7,"redis_duration_s":0.001729,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001238,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016039,"completed_at":"2026-09-03T10:33:10.557Z","load_balancing_strategy":"primary","db_duration_s":0.000635,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.905412] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.559Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cd7e9bbf1359c92c43a37585","created_at":"2026-09-03T10:33:09.532Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.534Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cd7e9bbf1359c92c43a37585: start","job_status":"start","queue_duration_s":1.024443,"scheduling_latency_s":1.024459} gitlab # [ 415.920545] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.584Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"cd7e9bbf1359c92c43a37585","created_at":"2026-09-03T10:33:09.532Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.534Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-cd7e9bbf1359c92c43a37585: done: 0.026022 sec","job_status":"done","queue_duration_s":1.024443,"scheduling_latency_s":1.024459,"redis_calls":7,"redis_duration_s":0.001765,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001268,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000497,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026022,"completed_at":"2026-09-03T10:33:10.584Z","load_balancing_strategy":"primary","db_duration_s":0.005434,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.961969] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.586Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4b059195f2a81d5d8f6659cb","created_at":"2026-09-03T10:33:09.606Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.608Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4b059195f2a81d5d8f6659cb: start","job_status":"start","queue_duration_s":0.977616,"scheduling_latency_s":0.977633} gitlab # [ 415.977314] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.615Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"4b059195f2a81d5d8f6659cb","created_at":"2026-09-03T10:33:09.606Z","trace_propagation_headers":{"sentry-trace":"0841af4960f143c5b235c0d1340ca12d-1271eb7442404db7","baggage":"sentry-trace_id=0841af4960f143c5b235c0d1340ca12d,sentry-release=Unknown"},"correlation_id":"01M1KD8P837BDS2RVF6VBB8SYN","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:09.608Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-4b059195f2a81d5d8f6659cb: done: 0.02854 sec","job_status":"done","queue_duration_s":0.977616,"scheduling_latency_s":0.977633,"redis_calls":8,"redis_duration_s":0.002031,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001548,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000483,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02854,"completed_at":"2026-09-03T10:33:10.615Z","load_balancing_strategy":"primary","db_duration_s":0.006249,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 416.018640] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.616Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"99b37f3703cddee23202abb1","created_at":"2026-09-03T10:33:10.100Z","trace_propagation_headers":{"sentry-trace":"b644b4efc7cf43aba9e63c8bd1a0f13a-c1cb43361ca04fa7","baggage":"sentry-trace_id=b644b4efc7cf43aba9e63c8bd1a0f13a,sentry-release=Unknown"},"correlation_id":"01M1KD8QR4GC2PDKB3ZQC2MACD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:10.103Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-99b37f3703cddee23202abb1: start","job_status":"start","queue_duration_s":0.513397,"scheduling_latency_s":0.513412} gitlab # [ 416.034609] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:10.652Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"99b37f3703cddee23202abb1","created_at":"2026-09-03T10:33:10.100Z","trace_propagation_headers":{"sentry-trace":"b644b4efc7cf43aba9e63c8bd1a0f13a-c1cb43361ca04fa7","baggage":"sentry-trace_id=b644b4efc7cf43aba9e63c8bd1a0f13a,sentry-release=Unknown"},"correlation_id":"01M1KD8QR4GC2PDKB3ZQC2MACD","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:10.103Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-99b37f3703cddee23202abb1: done: 0.036424 sec","job_status":"done","queue_duration_s":0.513397,"scheduling_latency_s":0.513412,"redis_calls":7,"redis_duration_s":0.001831,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001323,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000508,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024897,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.036424,"completed_at":"2026-09-03T10:33:10.652Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007837,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses gitlab # [ 416.617152] gitaly[920]: time="2026-09-03T10:33:11.487Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8SYTRTBVK130QTF2X6GG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:41.384" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:11.485" grpc.time_ms=1.447 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses, in 0.23 seconds) gitlab # [ 416.667858] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:11 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 151 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses gitlab # [ 417.823455] gitaly[920]: time="2026-09-03T10:33:12.693Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8V4GEJB1SXDRTB3KG2E3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:42.091" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:12.692" grpc.time_ms=1.231 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.877689] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:12 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 154 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses, in 0.22 seconds) gitlab # [ 418.081565] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:12.951Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b4ae49e35e3f3607f98b158e","created_at":"2026-09-03T10:33:12.764Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8f0c524f72b24c7c8abe9d90d4840fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:12.948Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b4ae49e35e3f3607f98b158e: start","job_status":"start","queue_duration_s":0.002532,"scheduling_latency_s":0.002559} gitlab # [ 418.328771] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.198Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b4ae49e35e3f3607f98b158e","created_at":"2026-09-03T10:33:12.764Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8f0c524f72b24c7c8abe9d90d4840fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:12.948Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b4ae49e35e3f3607f98b158e: done: 0.2465 sec","job_status":"done","queue_duration_s":0.002532,"scheduling_latency_s":0.002559,"redis_calls":18,"redis_duration_s":0.026091,"redis_read_bytes":19,"redis_write_bytes":4702,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.004119,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.003549,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.014164,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.004259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.090774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.2465,"completed_at":"2026-09-03T10:33:13.197Z","load_balancing_strategy":"primary","db_duration_s":0.031449,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.431858] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.207Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a02660973c7ad737243e6c3d","created_at":"2026-09-03T10:33:12.970Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f82472be2ead0207a68c50a9ec1bdf12","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:12.985Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a02660973c7ad737243e6c3d: start","job_status":"start","queue_duration_s":0.222095,"scheduling_latency_s":0.222192} gitlab # [ 418.522728] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.390Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a02660973c7ad737243e6c3d","created_at":"2026-09-03T10:33:12.970Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f82472be2ead0207a68c50a9ec1bdf12","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:12.985Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a02660973c7ad737243e6c3d: done: 0.18298 sec","job_status":"done","queue_duration_s":0.222095,"scheduling_latency_s":0.222192,"redis_calls":11,"redis_duration_s":0.060704,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.050132,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007958,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002614,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.18298,"completed_at":"2026-09-03T10:33:13.390Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010459,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.622887] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.404Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fc33ed9da52dd649813c5897","created_at":"2026-09-03T10:33:13.008Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad5008b5ad3fb4156df7b6a63b7d28b6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.014Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fc33ed9da52dd649813c5897: start","job_status":"start","queue_duration_s":0.389725,"scheduling_latency_s":0.389773} gitlab # [ 418.663136] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.534Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 418.702051] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.572Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"fc33ed9da52dd649813c5897","created_at":"2026-09-03T10:33:13.008Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ad5008b5ad3fb4156df7b6a63b7d28b6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.014Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-fc33ed9da52dd649813c5897: done: 0.16768 sec","job_status":"done","queue_duration_s":0.389725,"scheduling_latency_s":0.389773,"redis_calls":9,"redis_duration_s":0.020896,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002583,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004384,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.16768,"completed_at":"2026-09-03T10:33:13.572Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.789686] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.589Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"5309c6265965ae3893cc414f","created_at":"2026-09-03T10:33:13.033Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f23ed5960ab60b9be75881176f8a82e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.042Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-5309c6265965ae3893cc414f: start","job_status":"start","queue_duration_s":0.546534,"scheduling_latency_s":0.54658} gitlab # [ 418.811791] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.634Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 418.816573] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.669Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"5309c6265965ae3893cc414f","created_at":"2026-09-03T10:33:13.033Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f23ed5960ab60b9be75881176f8a82e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.042Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-5309c6265965ae3893cc414f: done: 0.080264 sec","job_status":"done","queue_duration_s":0.546534,"scheduling_latency_s":0.54658,"redis_calls":9,"redis_duration_s":0.017469,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005685,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009078,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002706,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.080264,"completed_at":"2026-09-03T10:33:13.669Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001229,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.863948] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.676Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5e9b265f2d5be738f10ad413","created_at":"2026-09-03T10:33:13.050Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82ebc191ffc05b5aa7ff18078b134008","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:33:13.057Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5e9b265f2d5be738f10ad413: start","job_status":"start","queue_duration_s":0.618727,"scheduling_latency_s":0.618775} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses gitlab # [ 418.881920] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.753Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 418.911697] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.782Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"5e9b265f2d5be738f10ad413","created_at":"2026-09-03T10:33:13.050Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"82ebc191ffc05b5aa7ff18078b134008","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-03T10:33:13.057Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-5e9b265f2d5be738f10ad413: done: 0.10591 sec","job_status":"done","queue_duration_s":0.618727,"scheduling_latency_s":0.618775,"redis_calls":9,"redis_duration_s":0.016004,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001892,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011513,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002599,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.10591,"completed_at":"2026-09-03T10:33:13.782Z","load_balancing_strategy":"primary","db_duration_s":0.006017,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.991984] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.846Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ec20f98b09fdd12c5a1163e1","created_at":"2026-09-03T10:33:13.079Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14b52f2b35433a24634c052f3af2b013","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.094Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ec20f98b09fdd12c5a1163e1: start","job_status":"start","queue_duration_s":0.752111,"scheduling_latency_s":0.752157} gitlab # [ 419.018653] gitaly[920]: time="2026-09-03T10:33:13.889Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8WAPQ06B59V7Y99JQQN4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:43.788" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:13.888" grpc.time_ms=0.61 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses, in 0.20 seconds) gitlab # [ 419.079482] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:13 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 134 gitlab # [ 419.086827] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.957Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 419.105129] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.975Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"ec20f98b09fdd12c5a1163e1","created_at":"2026-09-03T10:33:13.079Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14b52f2b35433a24634c052f3af2b013","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.094Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-ec20f98b09fdd12c5a1163e1: done: 0.12905 sec","job_status":"done","queue_duration_s":0.752111,"scheduling_latency_s":0.752157,"redis_calls":9,"redis_duration_s":0.004281,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00077,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002582,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000929,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.035857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.12905,"completed_at":"2026-09-03T10:33:13.975Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007632,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.174623] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:13.978Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ea39ab23829c098e6eee083e","created_at":"2026-09-03T10:33:13.084Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-6cc2ad913d104fa4","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8f0c524f72b24c7c8abe9d90d4840fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.141Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ea39ab23829c098e6eee083e: start","job_status":"start","queue_duration_s":0.836794,"scheduling_latency_s":0.836826} gitlab # [ 419.188353] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.008Z","message":"No existing merge request to be cleaned up."} gitlab # [ 419.190044] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.036Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ea39ab23829c098e6eee083e","created_at":"2026-09-03T10:33:13.084Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-6cc2ad913d104fa4","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8f0c524f72b24c7c8abe9d90d4840fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.141Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ea39ab23829c098e6eee083e: done: 0.058074 sec","job_status":"done","queue_duration_s":0.836794,"scheduling_latency_s":0.836826,"redis_calls":12,"redis_duration_s":0.004547,"redis_read_bytes":10,"redis_write_bytes":1323,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000763,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00146,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002324,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03535,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.058074,"completed_at":"2026-09-03T10:33:14.036Z","load_balancing_strategy":"primary","db_duration_s":0.008118,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.230740] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.040Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"507abb67f14ee25848669adb","created_at":"2026-09-03T10:33:13.084Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-6cc2ad913d104fa4","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8f0c524f72b24c7c8abe9d90d4840fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.141Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-507abb67f14ee25848669adb: start","job_status":"start","queue_duration_s":0.898684,"scheduling_latency_s":0.898731} gitlab # [ 419.243594] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.065Z","message":"No existing merge request to be cleaned up."} gitlab # [ 419.245390] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.085Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"507abb67f14ee25848669adb","created_at":"2026-09-03T10:33:13.084Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-6cc2ad913d104fa4","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8f0c524f72b24c7c8abe9d90d4840fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.141Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-507abb67f14ee25848669adb: done: 0.045039 sec","job_status":"done","queue_duration_s":0.898684,"scheduling_latency_s":0.898731,"redis_calls":10,"redis_duration_s":0.003959,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001683,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002276,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031778,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045039,"completed_at":"2026-09-03T10:33:14.085Z","load_balancing_strategy":"primary","db_duration_s":0.003467,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.283580] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.088Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2349b0cb2ebf9a34260864ce","created_at":"2026-09-03T10:33:13.084Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-6cc2ad913d104fa4","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8f0c524f72b24c7c8abe9d90d4840fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.141Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2349b0cb2ebf9a34260864ce: start","job_status":"start","queue_duration_s":0.946383,"scheduling_latency_s":0.946417} gitlab # [ 419.295674] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.113Z","message":"No existing merge request to be cleaned up."} gitlab # [ 419.297384] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.132Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"2349b0cb2ebf9a34260864ce","created_at":"2026-09-03T10:33:13.084Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-6cc2ad913d104fa4","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8f0c524f72b24c7c8abe9d90d4840fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.141Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-2349b0cb2ebf9a34260864ce: done: 0.044972 sec","job_status":"done","queue_duration_s":0.946383,"scheduling_latency_s":0.946417,"redis_calls":10,"redis_duration_s":0.004697,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001976,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002721,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044972,"completed_at":"2026-09-03T10:33:14.132Z","load_balancing_strategy":"primary","db_duration_s":0.003373,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.335375] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.137Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"807774b16024c4a8f1315a59","created_at":"2026-09-03T10:33:13.084Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-6cc2ad913d104fa4","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8f0c524f72b24c7c8abe9d90d4840fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.141Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-807774b16024c4a8f1315a59: start","job_status":"start","queue_duration_s":0.995335,"scheduling_latency_s":0.995401} gitlab # [ 419.347937] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.162Z","message":"No existing merge request to be cleaned up."} gitlab # [ 419.349769] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.180Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"807774b16024c4a8f1315a59","created_at":"2026-09-03T10:33:13.084Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-6cc2ad913d104fa4","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8f0c524f72b24c7c8abe9d90d4840fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.141Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-807774b16024c4a8f1315a59: done: 0.043352 sec","job_status":"done","queue_duration_s":0.995335,"scheduling_latency_s":0.995401,"redis_calls":10,"redis_duration_s":0.0038719999999999996,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002283,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030155,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043352,"completed_at":"2026-09-03T10:33:14.180Z","load_balancing_strategy":"primary","db_duration_s":0.003357,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.387706] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.183Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"bc21dfa77a0ac4858a5c5931","created_at":"2026-09-03T10:33:13.130Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"878a25db122c251e0d1159eb4b627e3e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.150Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-bc21dfa77a0ac4858a5c5931: start","job_status":"start","queue_duration_s":1.032441,"scheduling_latency_s":1.032473} gitlab # [ 419.427584] nix-daemon[3684]: accepted connection from pid 4368, user nixbot gitlab # [ 419.453653] nix-daemon[3684]: accepted connection from pid 4327, user nixbot gitlab # [ 419.741990] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"bc21dfa77a0ac4858a5c5931","created_at":"2026-09-03T10:33:13.130Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"878a25db122c251e0d1159eb4b627e3e","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.150Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-bc21dfa77a0ac4858a5c5931: done: 0.429979 sec","job_status":"done","queue_duration_s":1.032441,"scheduling_latency_s":1.032473,"redis_calls":564,"redis_duration_s":0.093965,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001087,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001903,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.090975,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.382107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.429979,"completed_at":"2026-09-03T10:33:14.612Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000922,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.815795] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.614Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e839fc6ef2549fe7b84303c1","created_at":"2026-09-03T10:33:13.187Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16205152cb97c53754918a7bd1206514","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.205Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e839fc6ef2549fe7b84303c1: start","job_status":"start","queue_duration_s":1.409379,"scheduling_latency_s":1.409398} gitlab # [ 419.832273] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.680Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e839fc6ef2549fe7b84303c1","created_at":"2026-09-03T10:33:13.187Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"16205152cb97c53754918a7bd1206514","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.205Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e839fc6ef2549fe7b84303c1: done: 0.065718 sec","job_status":"done","queue_duration_s":1.409379,"scheduling_latency_s":1.409398,"redis_calls":11,"redis_duration_s":0.0031980000000000003,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0005,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001322,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001376,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0007771,"exclusive_lock_hold_duration_s":0.036107,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.065718,"completed_at":"2026-09-03T10:33:14.680Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.878900] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.682Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f65af4f3a054cc70f1e13d8d","created_at":"2026-09-03T10:33:13.221Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b04d12db10920f7664c78434c94f268","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.232Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f65af4f3a054cc70f1e13d8d: start","job_status":"start","queue_duration_s":1.449523,"scheduling_latency_s":1.449541} gitlab # [ 419.893141] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.730Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"f65af4f3a054cc70f1e13d8d","created_at":"2026-09-03T10:33:13.221Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b04d12db10920f7664c78434c94f268","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.232Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-f65af4f3a054cc70f1e13d8d: done: 0.048431 sec","job_status":"done","queue_duration_s":1.449523,"scheduling_latency_s":1.449541,"redis_calls":11,"redis_duration_s":0.004442,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000718,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002225,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001499,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00115312,"exclusive_lock_hold_duration_s":0.01218532,"duration_s":0.048431,"completed_at":"2026-09-03T10:33:14.730Z","load_balancing_strategy":"primary","db_duration_s":0.003779,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.933507] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.733Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"be98eed5e5a25aacd3b0641b","created_at":"2026-09-03T10:33:13.250Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b51901e01b6aa9caa2e2d763fe1a1cf8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.278Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-be98eed5e5a25aacd3b0641b: start","job_status":"start","queue_duration_s":1.454064,"scheduling_latency_s":1.454097} gitlab # [ 419.947717] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.755Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 419.951397] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.766Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"be98eed5e5a25aacd3b0641b","created_at":"2026-09-03T10:33:13.250Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b51901e01b6aa9caa2e2d763fe1a1cf8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.278Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-be98eed5e5a25aacd3b0641b: done: 0.033506 sec","job_status":"done","queue_duration_s":1.454064,"scheduling_latency_s":1.454097,"redis_calls":9,"redis_duration_s":0.003089,"redis_read_bytes":7,"redis_write_bytes":1105,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000666,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001578,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000845,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033506,"completed_at":"2026-09-03T10:33:14.766Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000792,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.992361] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:14.768Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"45388db21ac6010c892c3576","created_at":"2026-09-03T10:33:13.339Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c910ff042d6b2797d12cf123a22263e1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.356Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-45388db21ac6010c892c3576: start","job_status":"start","queue_duration_s":1.412398,"scheduling_latency_s":1.412424} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses gitlab # [ 420.258257] gitaly[920]: time="2026-09-03T10:33:15.128Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8XGHQK111DMTHYSRWTJA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:45.025" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:15.126" grpc.time_ms=1.463 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 420.298511] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 143 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses, in 0.22 seconds) gitlab # [ 420.351931] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.221Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"45388db21ac6010c892c3576","created_at":"2026-09-03T10:33:13.339Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c910ff042d6b2797d12cf123a22263e1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.356Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-45388db21ac6010c892c3576: done: 0.453176 sec","job_status":"done","queue_duration_s":1.412398,"scheduling_latency_s":1.412424,"redis_calls":13,"redis_duration_s":0.00502,"redis_read_bytes":11,"redis_write_bytes":1563,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001728,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001588,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001704,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.069,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.067,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.370072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00141606,"exclusive_lock_hold_duration_s":0.4153283,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.453176,"completed_at":"2026-09-03T10:33:15.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.1027,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.434785] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.224Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bb3e99a663b49ba6821c68da","created_at":"2026-09-03T10:33:13.381Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8bd93f986be203f17eec53fd48b4fc3e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.401Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bb3e99a663b49ba6821c68da: start","job_status":"start","queue_duration_s":1.822203,"scheduling_latency_s":1.822229} gitlab # [ 420.450822] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.248Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"bb3e99a663b49ba6821c68da","created_at":"2026-09-03T10:33:13.381Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8bd93f986be203f17eec53fd48b4fc3e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.401Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-bb3e99a663b49ba6821c68da: done: 0.024348 sec","job_status":"done","queue_duration_s":1.822203,"scheduling_latency_s":1.822229,"redis_calls":9,"redis_duration_s":0.0023510000000000002,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0005,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013446,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024348,"completed_at":"2026-09-03T10:33:15.248Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000762,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.496058] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.250Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b80b77b9ff296ff21148679f","created_at":"2026-09-03T10:33:13.420Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.433Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b80b77b9ff296ff21148679f: start","job_status":"start","queue_duration_s":1.81652,"scheduling_latency_s":1.816538} gitlab # [ 420.592931] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.463Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b80b77b9ff296ff21148679f","created_at":"2026-09-03T10:33:13.420Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.433Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b80b77b9ff296ff21148679f: done: 0.213747 sec","job_status":"done","queue_duration_s":1.81652,"scheduling_latency_s":1.816538,"redis_calls":70,"redis_duration_s":0.016937,"redis_read_bytes":118,"redis_write_bytes":42580,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002372,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000635,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013203,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000727,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.194874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.213747,"completed_at":"2026-09-03T10:33:15.463Z","load_balancing_strategy":"primary","db_duration_s":0.002562,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.686004] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.470Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"b37d043fdcf4f2e9d644ef9f","created_at":"2026-09-03T10:33:13.445Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa55c6226e0e191f88d5a6b88fba7f15","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.468Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-b37d043fdcf4f2e9d644ef9f: start","job_status":"start","queue_duration_s":2.001552,"scheduling_latency_s":2.001602} gitlab # [ 420.705250] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.522Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"b37d043fdcf4f2e9d644ef9f","created_at":"2026-09-03T10:33:13.445Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa55c6226e0e191f88d5a6b88fba7f15","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.468Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-b37d043fdcf4f2e9d644ef9f: done: 0.052035 sec","job_status":"done","queue_duration_s":2.001552,"scheduling_latency_s":2.001602,"redis_calls":12,"redis_duration_s":0.003925,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000609,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001837,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001479,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00114752,"exclusive_lock_hold_duration_s":0.014079,"duration_s":0.052035,"completed_at":"2026-09-03T10:33:15.522Z","load_balancing_strategy":"primary","db_duration_s":0.005831,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.750172] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.524Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e8dc153ca21fdb251d63f3a6","created_at":"2026-09-03T10:33:13.531Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0059480cbc140065417463f625ad08a9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.565Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e8dc153ca21fdb251d63f3a6: start","job_status":"start","queue_duration_s":1.958565,"scheduling_latency_s":1.958591} gitlab # [ 420.764666] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e8dc153ca21fdb251d63f3a6","created_at":"2026-09-03T10:33:13.531Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0059480cbc140065417463f625ad08a9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.565Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e8dc153ca21fdb251d63f3a6: done: 0.058323 sec","job_status":"done","queue_duration_s":1.958565,"scheduling_latency_s":1.958591,"redis_calls":11,"redis_duration_s":0.003242,"redis_read_bytes":9,"redis_write_bytes":1509,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000556,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001431,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001255,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065414,"exclusive_lock_hold_duration_s":0.0322525,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.058323,"completed_at":"2026-09-03T10:33:15.582Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018406,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.808392] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.584Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"afc1f7a6bcd45a3d609b0cb9","created_at":"2026-09-03T10:33:13.582Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c9fdc3bc135e5a326b2436a2fae8a98","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.610Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-afc1f7a6bcd45a3d609b0cb9: start","job_status":"start","queue_duration_s":1.973477,"scheduling_latency_s":1.973497} gitlab # [ 420.821901] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.614Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"afc1f7a6bcd45a3d609b0cb9","created_at":"2026-09-03T10:33:13.582Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c9fdc3bc135e5a326b2436a2fae8a98","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.610Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-afc1f7a6bcd45a3d609b0cb9: done: 0.030669 sec","job_status":"done","queue_duration_s":1.973477,"scheduling_latency_s":1.973497,"redis_calls":9,"redis_duration_s":0.002555,"redis_read_bytes":7,"redis_write_bytes":984,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000585,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001417,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000553,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030669,"completed_at":"2026-09-03T10:33:15.614Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004251,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.863702] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0b8fa21caf88c0067617d44e","created_at":"2026-09-03T10:33:13.635Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdd75a4db8da6dcb8d8c4a6ee9d0f5ae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:33:13.665Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0b8fa21caf88c0067617d44e: start","job_status":"start","queue_duration_s":1.950465,"scheduling_latency_s":1.950484} gitlab # [ 420.877100] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.629Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 420.880350] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.637Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0b8fa21caf88c0067617d44e","created_at":"2026-09-03T10:33:13.635Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bdd75a4db8da6dcb8d8c4a6ee9d0f5ae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-03T10:33:13.665Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0b8fa21caf88c0067617d44e: done: 0.021294 sec","job_status":"done","queue_duration_s":1.950465,"scheduling_latency_s":1.950484,"redis_calls":9,"redis_duration_s":0.002419,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000592,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001332,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000495,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012358,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021294,"completed_at":"2026-09-03T10:33:15.637Z","load_balancing_strategy":"primary","db_duration_s":0.000709,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.920247] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.639Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9465fa579621e998d39874de","created_at":"2026-09-03T10:33:13.686Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9a4627ba2d8be1393fa64ab8fbaeed2","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.698Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9465fa579621e998d39874de: start","job_status":"start","queue_duration_s":1.940155,"scheduling_latency_s":1.940171} gitlab # [ 420.934081] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.668Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9465fa579621e998d39874de","created_at":"2026-09-03T10:33:13.686Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d9a4627ba2d8be1393fa64ab8fbaeed2","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.698Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9465fa579621e998d39874de: done: 0.029777 sec","job_status":"done","queue_duration_s":1.940155,"scheduling_latency_s":1.940171,"redis_calls":9,"redis_duration_s":0.002521,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000591,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001392,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000538,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029777,"completed_at":"2026-09-03T10:33:15.668Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006549,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.975016] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.670Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"204803b76e7492d912e76276","created_at":"2026-09-03T10:33:13.725Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"962cb998d7d0fc7896aa9c4cdcf32bf4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.747Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-204803b76e7492d912e76276: start","job_status":"start","queue_duration_s":1.923426,"scheduling_latency_s":1.923442} gitlab # [ 420.988716] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.712Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"204803b76e7492d912e76276","created_at":"2026-09-03T10:33:13.725Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"962cb998d7d0fc7896aa9c4cdcf32bf4","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.747Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-204803b76e7492d912e76276: done: 0.042242 sec","job_status":"done","queue_duration_s":1.923426,"scheduling_latency_s":1.923442,"redis_calls":9,"redis_duration_s":0.002535,"redis_read_bytes":7,"redis_write_bytes":1183,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000499,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001474,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.042242,"completed_at":"2026-09-03T10:33:15.712Z","load_balancing_strategy":"primary","db_duration_s":0.018561,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.030083] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.714Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"b3c5fc2dc032a4daf8d38abc","created_at":"2026-09-03T10:33:13.766Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.788Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-b3c5fc2dc032a4daf8d38abc: start","job_status":"start","queue_duration_s":1.925933,"scheduling_latency_s":1.925952} gitlab # [ 421.044282] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.762Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"b3c5fc2dc032a4daf8d38abc","created_at":"2026-09-03T10:33:13.766Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.788Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-b3c5fc2dc032a4daf8d38abc: done: 0.047515 sec","job_status":"done","queue_duration_s":1.925933,"scheduling_latency_s":1.925952,"redis_calls":28,"redis_duration_s":0.006732,"redis_read_bytes":36,"redis_write_bytes":10583,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001015,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":680,"redis_queues_calls":2,"redis_queues_duration_s":0.000416,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8295,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.00383,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001471,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032188,"duration_s":0.047515,"completed_at":"2026-09-03T10:33:15.762Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.087929] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.763Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4252f697f957fc5f8230d3a7","created_at":"2026-09-03T10:33:13.839Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"195ff321f0f27498661078a382da8895","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.851Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4252f697f957fc5f8230d3a7: start","job_status":"start","queue_duration_s":1.912069,"scheduling_latency_s":1.912084} gitlab # [ 421.102260] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.796Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"4252f697f957fc5f8230d3a7","created_at":"2026-09-03T10:33:13.839Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"195ff321f0f27498661078a382da8895","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.851Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-4252f697f957fc5f8230d3a7: done: 0.033146 sec","job_status":"done","queue_duration_s":1.912069,"scheduling_latency_s":1.912084,"redis_calls":12,"redis_duration_s":0.003256,"redis_read_bytes":10,"redis_write_bytes":1576,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000539,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00151,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001207,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00890102,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.033146,"completed_at":"2026-09-03T10:33:15.796Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004303,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 421.145552] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.798Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e1eefd20b06d5f127b9b1c6e","created_at":"2026-09-03T10:33:13.866Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d39516be3cd21c79be9cd567ef8c0b30","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:33:13.876Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e1eefd20b06d5f127b9b1c6e: start","job_status":"start","queue_duration_s":1.921863,"scheduling_latency_s":1.921877} gitlab # [ 421.158573] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.831Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e1eefd20b06d5f127b9b1c6e","created_at":"2026-09-03T10:33:13.866Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d39516be3cd21c79be9cd567ef8c0b30","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-03T10:33:13.876Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e1eefd20b06d5f127b9b1c6e: done: 0.033702 sec","job_status":"done","queue_duration_s":1.921863,"scheduling_latency_s":1.921877,"redis_calls":9,"redis_duration_s":0.0024679999999999997,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000498,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001408,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033702,"completed_at":"2026-09-03T10:33:15.831Z","load_balancing_strategy":"primary","db_duration_s":0.005797,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.198396] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.833Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"89615ce8a1240de11aa8e6d5","created_at":"2026-09-03T10:33:13.886Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"406e45a64d53abde7469443f083a0f1e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.895Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-89615ce8a1240de11aa8e6d5: start","job_status":"start","queue_duration_s":1.938049,"scheduling_latency_s":1.938064} gitlab # [ 421.212283] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.859Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"89615ce8a1240de11aa8e6d5","created_at":"2026-09-03T10:33:13.886Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-41965e28c7b54692","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"406e45a64d53abde7469443f083a0f1e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:13.895Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-89615ce8a1240de11aa8e6d5: done: 0.025873 sec","job_status":"done","queue_duration_s":1.938049,"scheduling_latency_s":1.938064,"redis_calls":11,"redis_duration_s":0.0034980000000000002,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000578,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001752,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001168,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005723,"exclusive_lock_hold_duration_s":0.0032446,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.025873,"completed_at":"2026-09-03T10:33:15.859Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002628,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.254876] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ae53ad80952387b95a8394a","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ae53ad80952387b95a8394a: start","job_status":"start","queue_duration_s":0.40513,"scheduling_latency_s":0.405146} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses gitlab # [ 421.267867] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ae53ad80952387b95a8394a","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ae53ad80952387b95a8394a: done: 0.032173 sec","job_status":"done","queue_duration_s":0.40513,"scheduling_latency_s":0.405146,"redis_calls":15,"redis_duration_s":0.004082,"redis_read_bytes":12,"redis_write_bytes":1464,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000658,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001291,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002133,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032173,"completed_at":"2026-09-03T10:33:15.892Z","load_balancing_strategy":"primary","db_duration_s":0.000702,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.307719] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d959d1c09b2e3ab68f94dad","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d959d1c09b2e3ab68f94dad: start","job_status":"start","queue_duration_s":0.441089,"scheduling_latency_s":0.44113} gitlab # [ 421.319066] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.933Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2d959d1c09b2e3ab68f94dad","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2d959d1c09b2e3ab68f94dad: done: 0.036592 sec","job_status":"done","queue_duration_s":0.441089,"scheduling_latency_s":0.44113,"redis_calls":13,"redis_duration_s":0.004252000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001457,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002795,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036592,"completed_at":"2026-09-03T10:33:15.933Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.356927] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23668a7636ae2f4091db81f4","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23668a7636ae2f4091db81f4: start","job_status":"start","queue_duration_s":0.479774,"scheduling_latency_s":0.4798} gitlab # [ 421.369234] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.962Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23668a7636ae2f4091db81f4","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23668a7636ae2f4091db81f4: done: 0.026832 sec","job_status":"done","queue_duration_s":0.479774,"scheduling_latency_s":0.4798,"redis_calls":13,"redis_duration_s":0.003941,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001179,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002762,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026832,"completed_at":"2026-09-03T10:33:15.962Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.408246] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.964Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d6d6f5790bb4bfe50d02e0c","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d6d6f5790bb4bfe50d02e0c: start","job_status":"start","queue_duration_s":0.508433,"scheduling_latency_s":0.508456} gitlab # [ 421.420577] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.987Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5d6d6f5790bb4bfe50d02e0c","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5d6d6f5790bb4bfe50d02e0c: done: 0.023404 sec","job_status":"done","queue_duration_s":0.508433,"scheduling_latency_s":0.508456,"redis_calls":13,"redis_duration_s":0.0035060000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002344,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023404,"completed_at":"2026-09-03T10:33:15.987Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.459308] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:15.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"962f75580b56f013a249ccac","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-962f75580b56f013a249ccac: start","job_status":"start","queue_duration_s":0.534972,"scheduling_latency_s":0.534995} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses, in 0.20 seconds) gitlab # [ 421.472722] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"962f75580b56f013a249ccac","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-962f75580b56f013a249ccac: done: 0.035075 sec","job_status":"done","queue_duration_s":0.534972,"scheduling_latency_s":0.534995,"redis_calls":13,"redis_duration_s":0.004569,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001672,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035075,"completed_at":"2026-09-03T10:33:16.025Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.512400] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.028Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f149e801c13e3bef4fb4bf6","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f149e801c13e3bef4fb4bf6: start","job_status":"start","queue_duration_s":0.573228,"scheduling_latency_s":0.573266} gitlab # [ 421.524972] gitaly[920]: time="2026-09-03T10:33:16.323Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8YPBRY0BQ94DGBRCX51S grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:46.221" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:16.322" grpc.time_ms=1.14 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 421.537911] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:16 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 117 gitlab # [ 421.540498] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f149e801c13e3bef4fb4bf6","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f149e801c13e3bef4fb4bf6: done: 0.033578 sec","job_status":"done","queue_duration_s":0.573228,"scheduling_latency_s":0.573266,"redis_calls":13,"redis_duration_s":0.004092999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001359,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002734,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.033578,"completed_at":"2026-09-03T10:33:16.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.579198] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c665f345a159ee1f4aea4068","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c665f345a159ee1f4aea4068: start","job_status":"start","queue_duration_s":0.609484,"scheduling_latency_s":0.609508} gitlab # [ 421.591650] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.088Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c665f345a159ee1f4aea4068","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c665f345a159ee1f4aea4068: done: 0.023218 sec","job_status":"done","queue_duration_s":0.609484,"scheduling_latency_s":0.609508,"redis_calls":13,"redis_duration_s":0.003313,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001122,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002191,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023218,"completed_at":"2026-09-03T10:33:16.088Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.630738] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13b7cb88fd71d06944019333","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13b7cb88fd71d06944019333: start","job_status":"start","queue_duration_s":0.634555,"scheduling_latency_s":0.634578} gitlab # [ 421.643043] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13b7cb88fd71d06944019333","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13b7cb88fd71d06944019333: done: 0.022016 sec","job_status":"done","queue_duration_s":0.634555,"scheduling_latency_s":0.634578,"redis_calls":13,"redis_duration_s":0.003239,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002138,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022016,"completed_at":"2026-09-03T10:33:16.112Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.682362] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17a9a257d2eedfc33d78a76d","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17a9a257d2eedfc33d78a76d: start","job_status":"start","queue_duration_s":0.658272,"scheduling_latency_s":0.65829} gitlab # [ 421.694792] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.133Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"17a9a257d2eedfc33d78a76d","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-17a9a257d2eedfc33d78a76d: done: 0.019248 sec","job_status":"done","queue_duration_s":0.658272,"scheduling_latency_s":0.65829,"redis_calls":13,"redis_duration_s":0.003085,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001048,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002037,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019248,"completed_at":"2026-09-03T10:33:16.133Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.733452] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.134Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8987f3fec1713994d3af52f8","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8987f3fec1713994d3af52f8: start","job_status":"start","queue_duration_s":0.67897,"scheduling_latency_s":0.678985} gitlab # [ 421.745601] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.151Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8987f3fec1713994d3af52f8","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8987f3fec1713994d3af52f8: done: 0.017334 sec","job_status":"done","queue_duration_s":0.67897,"scheduling_latency_s":0.678985,"redis_calls":13,"redis_duration_s":0.0031060000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002086,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011181,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017334,"completed_at":"2026-09-03T10:33:16.151Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.784439] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"610c1b89dc57d9015cf9fc3c","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-610c1b89dc57d9015cf9fc3c: start","job_status":"start","queue_duration_s":0.69782,"scheduling_latency_s":0.697836} gitlab # [ 421.796444] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"610c1b89dc57d9015cf9fc3c","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-610c1b89dc57d9015cf9fc3c: done: 0.015705 sec","job_status":"done","queue_duration_s":0.69782,"scheduling_latency_s":0.697836,"redis_calls":13,"redis_duration_s":0.002699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001771,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015705,"completed_at":"2026-09-03T10:33:16.169Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.835081] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a4eaa38870116e4f7d5cdf3","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a4eaa38870116e4f7d5cdf3: start","job_status":"start","queue_duration_s":0.71486,"scheduling_latency_s":0.714874} gitlab # [ 421.847460] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a4eaa38870116e4f7d5cdf3","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a4eaa38870116e4f7d5cdf3: done: 0.015159 sec","job_status":"done","queue_duration_s":0.71486,"scheduling_latency_s":0.714874,"redis_calls":13,"redis_duration_s":0.002754,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000921,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001833,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015159,"completed_at":"2026-09-03T10:33:16.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.886904] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86f397f1e4fe1de759174007","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86f397f1e4fe1de759174007: start","job_status":"start","queue_duration_s":0.731366,"scheduling_latency_s":0.73138} gitlab # [ 421.899193] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"86f397f1e4fe1de759174007","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-86f397f1e4fe1de759174007: done: 0.015024 sec","job_status":"done","queue_duration_s":0.731366,"scheduling_latency_s":0.73138,"redis_calls":13,"redis_duration_s":0.002884,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015024,"completed_at":"2026-09-03T10:33:16.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.937961] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e63c19566445521376f2487c","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e63c19566445521376f2487c: start","job_status":"start","queue_duration_s":0.747744,"scheduling_latency_s":0.747758} gitlab # [ 421.950370] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e63c19566445521376f2487c","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e63c19566445521376f2487c: done: 0.028432 sec","job_status":"done","queue_duration_s":0.747744,"scheduling_latency_s":0.747758,"redis_calls":13,"redis_duration_s":0.005951,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001395,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004556,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028432,"completed_at":"2026-09-03T10:33:16.231Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 421.988838] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fc042ce23b17812de53de6f","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fc042ce23b17812de53de6f: start","job_status":"start","queue_duration_s":0.779186,"scheduling_latency_s":0.779224} gitlab # [ 422.001311] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fc042ce23b17812de53de6f","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fc042ce23b17812de53de6f: done: 0.036856 sec","job_status":"done","queue_duration_s":0.779186,"scheduling_latency_s":0.779224,"redis_calls":13,"redis_duration_s":0.004458999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.036856,"completed_at":"2026-09-03T10:33:16.271Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.039825] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.274Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0447d95919a0d61b7a4625a9","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0447d95919a0d61b7a4625a9: start","job_status":"start","queue_duration_s":0.818862,"scheduling_latency_s":0.818885} gitlab # [ 422.052071] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0447d95919a0d61b7a4625a9","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0447d95919a0d61b7a4625a9: done: 0.041747 sec","job_status":"done","queue_duration_s":0.818862,"scheduling_latency_s":0.818885,"redis_calls":13,"redis_duration_s":0.012438999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.004867,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.007572,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01951,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041747,"completed_at":"2026-09-03T10:33:16.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.091100] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.319Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"606368b30ff102df7e0f932e","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-606368b30ff102df7e0f932e: start","job_status":"start","queue_duration_s":0.863502,"scheduling_latency_s":0.863535} gitlab # [ 422.103383] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"606368b30ff102df7e0f932e","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-606368b30ff102df7e0f932e: done: 0.027881 sec","job_status":"done","queue_duration_s":0.863502,"scheduling_latency_s":0.863535,"redis_calls":13,"redis_duration_s":0.003784,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001308,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002476,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027881,"completed_at":"2026-09-03T10:33:16.346Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.141841] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efa545421eef62a6901833b8","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efa545421eef62a6901833b8: start","job_status":"start","queue_duration_s":0.893263,"scheduling_latency_s":0.893286} gitlab # [ 422.153893] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efa545421eef62a6901833b8","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efa545421eef62a6901833b8: done: 0.022203 sec","job_status":"done","queue_duration_s":0.893263,"scheduling_latency_s":0.893286,"redis_calls":13,"redis_duration_s":0.0038390000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001655,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002184,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014132,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022203,"completed_at":"2026-09-03T10:33:16.371Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.192144] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c2194b62ec2ef5676be09d4","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c2194b62ec2ef5676be09d4: start","job_status":"start","queue_duration_s":0.917155,"scheduling_latency_s":0.917172} gitlab # [ 422.204405] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.389Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c2194b62ec2ef5676be09d4","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c2194b62ec2ef5676be09d4: done: 0.01681 sec","job_status":"done","queue_duration_s":0.917155,"scheduling_latency_s":0.917172,"redis_calls":13,"redis_duration_s":0.002254,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000793,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001461,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01681,"completed_at":"2026-09-03T10:33:16.389Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.242410] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.391Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12b7ac36c581354788a1d682","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12b7ac36c581354788a1d682: start","job_status":"start","queue_duration_s":0.935346,"scheduling_latency_s":0.935363} gitlab # [ 422.254446] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12b7ac36c581354788a1d682","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12b7ac36c581354788a1d682: done: 0.016991 sec","job_status":"done","queue_duration_s":0.935346,"scheduling_latency_s":0.935363,"redis_calls":13,"redis_duration_s":0.0028269999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001143,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001684,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016991,"completed_at":"2026-09-03T10:33:16.407Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.292620] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78bde2278320e2d2ca905225","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78bde2278320e2d2ca905225: start","job_status":"start","queue_duration_s":0.95424,"scheduling_latency_s":0.954261} gitlab # [ 422.305528] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78bde2278320e2d2ca905225","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78bde2278320e2d2ca905225: done: 0.015189 sec","job_status":"done","queue_duration_s":0.95424,"scheduling_latency_s":0.954261,"redis_calls":13,"redis_duration_s":0.0026680000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009526,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015189,"completed_at":"2026-09-03T10:33:16.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.344385] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"137da9e5eb2b8bd5f998deb4","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-137da9e5eb2b8bd5f998deb4: start","job_status":"start","queue_duration_s":0.970757,"scheduling_latency_s":0.970772} gitlab # [ 422.356480] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"137da9e5eb2b8bd5f998deb4","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-137da9e5eb2b8bd5f998deb4: done: 0.015342 sec","job_status":"done","queue_duration_s":0.970757,"scheduling_latency_s":0.970772,"redis_calls":13,"redis_duration_s":0.002882,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00192,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009727,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015342,"completed_at":"2026-09-03T10:33:16.441Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.395257] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f96e63f6dcfbae7c631d4814","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f96e63f6dcfbae7c631d4814: start","job_status":"start","queue_duration_s":0.987464,"scheduling_latency_s":0.98762} gitlab # [ 422.407490] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f96e63f6dcfbae7c631d4814","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f96e63f6dcfbae7c631d4814: done: 0.014708 sec","job_status":"done","queue_duration_s":0.987464,"scheduling_latency_s":0.98762,"redis_calls":13,"redis_duration_s":0.002634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001731,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014708,"completed_at":"2026-09-03T10:33:16.457Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.446175] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.459Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11f83d6c2400ad012d11aaef","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11f83d6c2400ad012d11aaef: start","job_status":"start","queue_duration_s":1.003521,"scheduling_latency_s":1.003535} gitlab # [ 422.458779] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11f83d6c2400ad012d11aaef","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11f83d6c2400ad012d11aaef: done: 0.014777 sec","job_status":"done","queue_duration_s":1.003521,"scheduling_latency_s":1.003535,"redis_calls":13,"redis_duration_s":0.002784,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009207,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014777,"completed_at":"2026-09-03T10:33:16.473Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses gitlab # [ 422.497311] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.475Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47c5dd13cb81ffe413c6da57","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47c5dd13cb81ffe413c6da57: start","job_status":"start","queue_duration_s":1.019673,"scheduling_latency_s":1.019687} gitlab # [ 422.509742] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"47c5dd13cb81ffe413c6da57","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-47c5dd13cb81ffe413c6da57: done: 0.015411 sec","job_status":"done","queue_duration_s":1.019673,"scheduling_latency_s":1.019687,"redis_calls":13,"redis_duration_s":0.003065,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002008,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00944,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015411,"completed_at":"2026-09-03T10:33:16.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.546183] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ada2543b6d1d28ebd6b0f1bd","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ada2543b6d1d28ebd6b0f1bd: start","job_status":"start","queue_duration_s":1.036441,"scheduling_latency_s":1.036456} gitlab # [ 422.558525] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.507Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ada2543b6d1d28ebd6b0f1bd","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ada2543b6d1d28ebd6b0f1bd: done: 0.014932 sec","job_status":"done","queue_duration_s":1.036441,"scheduling_latency_s":1.036456,"redis_calls":13,"redis_duration_s":0.002607,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009333,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014932,"completed_at":"2026-09-03T10:33:16.506Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.597175] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5219ffe5364fa57dc266c67","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5219ffe5364fa57dc266c67: start","job_status":"start","queue_duration_s":1.052747,"scheduling_latency_s":1.052761} gitlab # [ 422.609768] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.523Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5219ffe5364fa57dc266c67","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5219ffe5364fa57dc266c67: done: 0.014748 sec","job_status":"done","queue_duration_s":1.052747,"scheduling_latency_s":1.052761,"redis_calls":13,"redis_duration_s":0.0026579999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001749,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014748,"completed_at":"2026-09-03T10:33:16.523Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.648464] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00cf2819bac212cf0a96ce7b","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00cf2819bac212cf0a96ce7b: start","job_status":"start","queue_duration_s":1.069107,"scheduling_latency_s":1.069121} gitlab # [ 422.660336] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.539Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"00cf2819bac212cf0a96ce7b","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-00cf2819bac212cf0a96ce7b: done: 0.015204 sec","job_status":"done","queue_duration_s":1.069107,"scheduling_latency_s":1.069121,"redis_calls":13,"redis_duration_s":0.002798,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015204,"completed_at":"2026-09-03T10:33:16.539Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.698688] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70437d846ac72e2f01662a09","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70437d846ac72e2f01662a09: start","job_status":"start","queue_duration_s":1.085712,"scheduling_latency_s":1.085726} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses, in 0.24 seconds) gitlab # [ 422.711272] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"70437d846ac72e2f01662a09","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-70437d846ac72e2f01662a09: done: 0.014943 sec","job_status":"done","queue_duration_s":1.085712,"scheduling_latency_s":1.085726,"redis_calls":13,"redis_duration_s":0.002763,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001818,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014943,"completed_at":"2026-09-03T10:33:16.556Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.750720] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64c21318ccc629a79752184e","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64c21318ccc629a79752184e: start","job_status":"start","queue_duration_s":1.102053,"scheduling_latency_s":1.102067} gitlab # [ 422.763318] gitaly[920]: time="2026-09-03T10:33:17.557Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD8ZWSJZ39D828TN2ZG95K grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:47.455" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:17.556" grpc.time_ms=1.141 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 422.776123] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 136 gitlab # [ 422.778675] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64c21318ccc629a79752184e","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64c21318ccc629a79752184e: done: 0.015111 sec","job_status":"done","queue_duration_s":1.102053,"scheduling_latency_s":1.102067,"redis_calls":13,"redis_duration_s":0.002752,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001822,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015111,"completed_at":"2026-09-03T10:33:16.572Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.816707] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85055783d793ba0d1f4be288","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85055783d793ba0d1f4be288: start","job_status":"start","queue_duration_s":1.118506,"scheduling_latency_s":1.11852} gitlab # [ 422.828680] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"85055783d793ba0d1f4be288","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-85055783d793ba0d1f4be288: done: 0.014524 sec","job_status":"done","queue_duration_s":1.118506,"scheduling_latency_s":1.11852,"redis_calls":13,"redis_duration_s":0.002594,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001677,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014524,"completed_at":"2026-09-03T10:33:16.588Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.866816] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e1560bd18e42e61c1f5c36c","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e1560bd18e42e61c1f5c36c: start","job_status":"start","queue_duration_s":1.134406,"scheduling_latency_s":1.13442} gitlab # [ 422.879021] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e1560bd18e42e61c1f5c36c","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e1560bd18e42e61c1f5c36c: done: 0.015084 sec","job_status":"done","queue_duration_s":1.134406,"scheduling_latency_s":1.13442,"redis_calls":13,"redis_duration_s":0.002656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001692,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015084,"completed_at":"2026-09-03T10:33:16.605Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.917450] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d1c72d84512f812db85d073","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d1c72d84512f812db85d073: start","job_status":"start","queue_duration_s":1.150832,"scheduling_latency_s":1.150846} gitlab # [ 422.930327] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7d1c72d84512f812db85d073","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7d1c72d84512f812db85d073: done: 0.014853 sec","job_status":"done","queue_duration_s":1.150832,"scheduling_latency_s":1.150846,"redis_calls":13,"redis_duration_s":0.002565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001665,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014853,"completed_at":"2026-09-03T10:33:16.621Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 422.968824] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a513b897582daa5419c7472","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a513b897582daa5419c7472: start","job_status":"start","queue_duration_s":1.166999,"scheduling_latency_s":1.167014} gitlab # [ 422.980943] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a513b897582daa5419c7472","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a513b897582daa5419c7472: done: 0.015626 sec","job_status":"done","queue_duration_s":1.166999,"scheduling_latency_s":1.167014,"redis_calls":13,"redis_duration_s":0.003014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002052,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015626,"completed_at":"2026-09-03T10:33:16.638Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.019624] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d268e507ec36958f10413f22","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d268e507ec36958f10413f22: start","job_status":"start","queue_duration_s":1.184216,"scheduling_latency_s":1.184231} gitlab # [ 423.032093] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d268e507ec36958f10413f22","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d268e507ec36958f10413f22: done: 0.015382 sec","job_status":"done","queue_duration_s":1.184216,"scheduling_latency_s":1.184231,"redis_calls":13,"redis_duration_s":0.002678,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009673,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015382,"completed_at":"2026-09-03T10:33:16.655Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.069986] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf6dbc98792ae254562e3745","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf6dbc98792ae254562e3745: start","job_status":"start","queue_duration_s":1.201265,"scheduling_latency_s":1.20128} gitlab # [ 423.082265] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cf6dbc98792ae254562e3745","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cf6dbc98792ae254562e3745: done: 0.015918 sec","job_status":"done","queue_duration_s":1.201265,"scheduling_latency_s":1.20128,"redis_calls":13,"redis_duration_s":0.00287,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015918,"completed_at":"2026-09-03T10:33:16.672Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.120239] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80dcb937742e71b13e9fea98","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80dcb937742e71b13e9fea98: start","job_status":"start","queue_duration_s":1.218974,"scheduling_latency_s":1.218989} gitlab # [ 423.133183] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80dcb937742e71b13e9fea98","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80dcb937742e71b13e9fea98: done: 0.015708 sec","job_status":"done","queue_duration_s":1.218974,"scheduling_latency_s":1.218989,"redis_calls":13,"redis_duration_s":0.0028599999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015708,"completed_at":"2026-09-03T10:33:16.690Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.171555] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af2019dbba658dad3c4b924d","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af2019dbba658dad3c4b924d: start","job_status":"start","queue_duration_s":1.236213,"scheduling_latency_s":1.236227} gitlab # [ 423.183788] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af2019dbba658dad3c4b924d","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af2019dbba658dad3c4b924d: done: 0.015641 sec","job_status":"done","queue_duration_s":1.236213,"scheduling_latency_s":1.236227,"redis_calls":13,"redis_duration_s":0.0029040000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001018,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015641,"completed_at":"2026-09-03T10:33:16.707Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.222754] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbd0fe90feb685731dce0709","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbd0fe90feb685731dce0709: start","job_status":"start","queue_duration_s":1.253509,"scheduling_latency_s":1.253525} gitlab # [ 423.235081] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cbd0fe90feb685731dce0709","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cbd0fe90feb685731dce0709: done: 0.01538 sec","job_status":"done","queue_duration_s":1.253509,"scheduling_latency_s":1.253525,"redis_calls":13,"redis_duration_s":0.0026810000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001763,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01538,"completed_at":"2026-09-03T10:33:16.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.273429] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb3282063bbe9876894be390","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb3282063bbe9876894be390: start","job_status":"start","queue_duration_s":1.270203,"scheduling_latency_s":1.270218} gitlab # [ 423.285470] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb3282063bbe9876894be390","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb3282063bbe9876894be390: done: 0.015931 sec","job_status":"done","queue_duration_s":1.270203,"scheduling_latency_s":1.270218,"redis_calls":13,"redis_duration_s":0.0031149999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015931,"completed_at":"2026-09-03T10:33:16.741Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.324363] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3680257df1dcc163ff718ef","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3680257df1dcc163ff718ef: start","job_status":"start","queue_duration_s":1.287568,"scheduling_latency_s":1.287583} gitlab # [ 423.336283] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3680257df1dcc163ff718ef","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3680257df1dcc163ff718ef: done: 0.015801 sec","job_status":"done","queue_duration_s":1.287568,"scheduling_latency_s":1.287583,"redis_calls":13,"redis_duration_s":0.002956,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002054,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015801,"completed_at":"2026-09-03T10:33:16.758Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.375344] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8e236d4bc1e7b6c7a2ca25f","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8e236d4bc1e7b6c7a2ca25f: start","job_status":"start","queue_duration_s":1.305202,"scheduling_latency_s":1.305218} gitlab # [ 423.387753] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b8e236d4bc1e7b6c7a2ca25f","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b8e236d4bc1e7b6c7a2ca25f: done: 0.016781 sec","job_status":"done","queue_duration_s":1.305202,"scheduling_latency_s":1.305218,"redis_calls":13,"redis_duration_s":0.003725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001353,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002372,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016781,"completed_at":"2026-09-03T10:33:16.777Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.426475] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c84027307691fb836792f5b","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c84027307691fb836792f5b: start","job_status":"start","queue_duration_s":1.323302,"scheduling_latency_s":1.323316} gitlab # [ 423.438850] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.795Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c84027307691fb836792f5b","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c84027307691fb836792f5b: done: 0.016522 sec","job_status":"done","queue_duration_s":1.323302,"scheduling_latency_s":1.323316,"redis_calls":13,"redis_duration_s":0.002889,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001957,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016522,"completed_at":"2026-09-03T10:33:16.795Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.477027] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dca3ceda9dcae726c77e5f18","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dca3ceda9dcae726c77e5f18: start","job_status":"start","queue_duration_s":1.341124,"scheduling_latency_s":1.341138} gitlab # [ 423.488962] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dca3ceda9dcae726c77e5f18","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dca3ceda9dcae726c77e5f18: done: 0.016405 sec","job_status":"done","queue_duration_s":1.341124,"scheduling_latency_s":1.341138,"redis_calls":13,"redis_duration_s":0.002814,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000964,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016405,"completed_at":"2026-09-03T10:33:16.813Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.527613] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b383c84239af5df115358d7","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b383c84239af5df115358d7: start","job_status":"start","queue_duration_s":1.359433,"scheduling_latency_s":1.359448} gitlab # [ 423.539752] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b383c84239af5df115358d7","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b383c84239af5df115358d7: done: 0.016226 sec","job_status":"done","queue_duration_s":1.359433,"scheduling_latency_s":1.359448,"redis_calls":13,"redis_duration_s":0.002689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001738,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016226,"completed_at":"2026-09-03T10:33:16.831Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.579035] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.833Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"828af78195db160938333aca","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-828af78195db160938333aca: start","job_status":"start","queue_duration_s":1.377552,"scheduling_latency_s":1.377568} gitlab # [ 423.591367] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"828af78195db160938333aca","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-828af78195db160938333aca: done: 0.01586 sec","job_status":"done","queue_duration_s":1.377552,"scheduling_latency_s":1.377568,"redis_calls":13,"redis_duration_s":0.002655,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001723,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01586,"completed_at":"2026-09-03T10:33:16.849Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.629618] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.850Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb812b9362f478652735ba61","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb812b9362f478652735ba61: start","job_status":"start","queue_duration_s":1.394792,"scheduling_latency_s":1.394806} gitlab # [ 423.641504] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fb812b9362f478652735ba61","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fb812b9362f478652735ba61: done: 0.015078 sec","job_status":"done","queue_duration_s":1.394792,"scheduling_latency_s":1.394806,"redis_calls":13,"redis_duration_s":0.0029360000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001266,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015078,"completed_at":"2026-09-03T10:33:16.865Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.679678] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.866Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d7f9b4efeaa460b9635a932","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d7f9b4efeaa460b9635a932: start","job_status":"start","queue_duration_s":1.411162,"scheduling_latency_s":1.411176} gitlab # [ 423.692027] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.881Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d7f9b4efeaa460b9635a932","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d7f9b4efeaa460b9635a932: done: 0.014847 sec","job_status":"done","queue_duration_s":1.411162,"scheduling_latency_s":1.411176,"redis_calls":13,"redis_duration_s":0.0028320000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014847,"completed_at":"2026-09-03T10:33:16.881Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.730040] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.883Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc58433ba80f97b1841d3e17","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc58433ba80f97b1841d3e17: start","job_status":"start","queue_duration_s":1.427344,"scheduling_latency_s":1.427358} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses gitlab # [ 423.742028] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc58433ba80f97b1841d3e17","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc58433ba80f97b1841d3e17: done: 0.014614 sec","job_status":"done","queue_duration_s":1.427344,"scheduling_latency_s":1.427358,"redis_calls":13,"redis_duration_s":0.002818,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001846,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014614,"completed_at":"2026-09-03T10:33:16.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.780212] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"018459ff45658834cd6f615d","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-018459ff45658834cd6f615d: start","job_status":"start","queue_duration_s":1.443237,"scheduling_latency_s":1.443251} gitlab # [ 423.793183] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"018459ff45658834cd6f615d","created_at":"2026-09-03T10:33:15.271Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-44ff8be00d564ec5","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fc4475de5147e8f29e93aa6e5b8b7afc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.455Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-018459ff45658834cd6f615d: done: 0.014621 sec","job_status":"done","queue_duration_s":1.443237,"scheduling_latency_s":1.443251,"redis_calls":13,"redis_duration_s":0.00282,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014621,"completed_at":"2026-09-03T10:33:16.913Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.831705] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"84578453ccc32f3bf6addd94","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-84578453ccc32f3bf6addd94: start","job_status":"start","queue_duration_s":1.160547,"scheduling_latency_s":1.16056} gitlab # [ 423.844676] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"84578453ccc32f3bf6addd94","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-84578453ccc32f3bf6addd94: done: 0.025129 sec","job_status":"done","queue_duration_s":1.160547,"scheduling_latency_s":1.16056,"redis_calls":16,"redis_duration_s":0.00381,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000538,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002194,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033232,"duration_s":0.025129,"completed_at":"2026-09-03T10:33:16.939Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.884879] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2dc21613b793de5d9f128714","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2dc21613b793de5d9f128714: start","job_status":"start","queue_duration_s":1.187043,"scheduling_latency_s":1.187057} gitlab # [ 423.897923] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2dc21613b793de5d9f128714","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2dc21613b793de5d9f128714: done: 0.016483 sec","job_status":"done","queue_duration_s":1.187043,"scheduling_latency_s":1.187057,"redis_calls":13,"redis_duration_s":0.0029449999999999997,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016483,"completed_at":"2026-09-03T10:33:16.957Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001254,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.936846] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"49cc0887c602f0edae5348df","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-49cc0887c602f0edae5348df: start","job_status":"start","queue_duration_s":1.204898,"scheduling_latency_s":1.204913} gitlab # [ 423.949928] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"49cc0887c602f0edae5348df","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-49cc0887c602f0edae5348df: done: 0.016394 sec","job_status":"done","queue_duration_s":1.204898,"scheduling_latency_s":1.204913,"redis_calls":13,"redis_duration_s":0.003062,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016394,"completed_at":"2026-09-03T10:33:16.975Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001284,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 423.988570] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"73e1718303087d9ef5ba6ac6","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-73e1718303087d9ef5ba6ac6: start","job_status":"start","queue_duration_s":1.22285,"scheduling_latency_s":1.222868} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses, in 0.26 seconds) gitlab # [ 424.002629] nix-daemon[3684]: accepted connection from pid 4327, user nixbot gitlab # [ 424.003818] gitaly[920]: time="2026-09-03T10:33:18.820Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=3 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD913R0KK1VKZMR8EB7GER grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:48.214" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:18.816" grpc.time_ms=3.839 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.016228] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"73e1718303087d9ef5ba6ac6","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-73e1718303087d9ef5ba6ac6: done: 0.016074 sec","job_status":"done","queue_duration_s":1.22285,"scheduling_latency_s":1.222868,"redis_calls":13,"redis_duration_s":0.002834,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016074,"completed_at":"2026-09-03T10:33:16.993Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001166,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.054546] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:16.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2254220b4cb2d1ce04a72458","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2254220b4cb2d1ce04a72458: start","job_status":"start","queue_duration_s":1.240308,"scheduling_latency_s":1.240322} gitlab # [ 424.068084] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses HTTP/1.1" 200 639 "" "curl/8.21.0" 151 gitlab # [ 424.070654] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:17.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2254220b4cb2d1ce04a72458","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2254220b4cb2d1ce04a72458: done: 0.015881 sec","job_status":"done","queue_duration_s":1.240308,"scheduling_latency_s":1.240322,"redis_calls":13,"redis_duration_s":0.002744,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015881,"completed_at":"2026-09-03T10:33:17.010Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001158,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.109730] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:17.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"ae64438292830800fa54c6be","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-ae64438292830800fa54c6be: start","job_status":"start","queue_duration_s":1.257587,"scheduling_latency_s":1.257602} gitlab # [ 424.123000] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:17.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"ae64438292830800fa54c6be","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-ae64438292830800fa54c6be: done: 0.021315 sec","job_status":"done","queue_duration_s":1.257587,"scheduling_latency_s":1.257602,"redis_calls":13,"redis_duration_s":0.007607000000000001,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00203,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005577,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009995,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021315,"completed_at":"2026-09-03T10:33:17.033Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00112,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.161975] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:17.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1d1f9786628b338065166853","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1d1f9786628b338065166853: start","job_status":"start","queue_duration_s":1.280269,"scheduling_latency_s":1.280284} gitlab # [ 424.174854] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:17.050Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"1d1f9786628b338065166853","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-1d1f9786628b338065166853: done: 0.016403 sec","job_status":"done","queue_duration_s":1.280269,"scheduling_latency_s":1.280284,"redis_calls":13,"redis_duration_s":0.003025,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000949,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002076,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009746,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016403,"completed_at":"2026-09-03T10:33:17.050Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001198,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.214764] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:17.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"89dfd1a96805736427dad473","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-89dfd1a96805736427dad473: start","job_status":"start","queue_duration_s":1.297996,"scheduling_latency_s":1.29801} gitlab # [ 424.227859] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:17.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"89dfd1a96805736427dad473","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-89dfd1a96805736427dad473: done: 0.01652 sec","job_status":"done","queue_duration_s":1.297996,"scheduling_latency_s":1.29801,"redis_calls":13,"redis_duration_s":0.0033559999999999996,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002417,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01652,"completed_at":"2026-09-03T10:33:17.068Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001133,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.266808] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:17.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"172ef393fcef0f170c71ae27","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-172ef393fcef0f170c71ae27: start","job_status":"start","queue_duration_s":1.315988,"scheduling_latency_s":1.316004} gitlab # [ 424.279977] gitaly[920]: time="2026-09-03T10:33:19.080Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD91BZPZF1X72D75D5BDVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:49.078" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:19.079" grpc.time_ms=1.245 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.292550] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:17.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"172ef393fcef0f170c71ae27","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-172ef393fcef0f170c71ae27: done: 0.01629 sec","job_status":"done","queue_duration_s":1.315988,"scheduling_latency_s":1.316004,"redis_calls":13,"redis_duration_s":0.003092,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01629,"completed_at":"2026-09-03T10:33:17.086Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001168,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.331829] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:17.087Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"cbe33e85ab23656e656075f0","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-cbe33e85ab23656e656075f0: start","job_status":"start","queue_duration_s":1.333635,"scheduling_latency_s":1.33365} gitlab # [ 424.345081] gitaly[920]: time="2026-09-03T10:33:19.153Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1KD91BZPZF1X72D75D5BDVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:29.109" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:19.140" grpc.time_ms=12.978 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.358402] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:17.103Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"cbe33e85ab23656e656075f0","created_at":"2026-09-03T10:33:15.731Z","trace_propagation_headers":{"sentry-trace":"13747e5466544d48873dded4f3446eff-23de1181c25543f3","baggage":"sentry-trace_id=13747e5466544d48873dded4f3446eff,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"125e0218f8e76222a00029c3143fadcb","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-03T10:33:15.754Z","job_size_bytes":2,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-cbe33e85ab23656e656075f0: done: 0.015836 sec","job_status":"done","queue_duration_s":1.333635,"scheduling_latency_s":1.33365,"redis_calls":13,"redis_duration_s":0.0027359999999999997,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001811,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015836,"completed_at":"2026-09-03T10:33:17.103Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001201,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.397418] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 201 675 "" "python-httpx/0.28.1" 263 gitlab # [ 424.400279] nixbot[3458]: {"ts": "2026-09-03T10:33:19.241Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/800a76504cdb0e3a9d9162945e09f3675c861f1a \"HTTP/1.1 201 Created\""} gitlab # [ 424.452451] gitaly[920]: time="2026-09-03T10:33:19.323Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD91ME654YTN6W0ENRQ36Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:49.222" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:19.322" grpc.time_ms=0.989 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.515648] gitaly[920]: time="2026-09-03T10:33:19.387Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD91ME654YTN6W0ENRQ36Z grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:29.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:19.369" grpc.time_ms=17.381 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.547349] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:19.388Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"08d5aef8c8d4d4deade16207","created_at":"2026-09-03T10:33:19.202Z","trace_propagation_headers":{"sentry-trace":"dde1416660b7499496257f14b77c7210-4ad643bbe3e4457d","baggage":"sentry-trace_id=dde1416660b7499496257f14b77c7210,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD91BZPZF1X72D75D5BDVZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:19.210Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-08d5aef8c8d4d4deade16207: start","job_status":"start","queue_duration_s":0.17817,"scheduling_latency_s":0.178223} gitlab # [ 424.582668] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 206 gitlab # [ 424.587892] nixbot[3458]: {"ts": "2026-09-03T10:33:19.455Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/800a76504cdb0e3a9d9162945e09f3675c861f1a \"HTTP/1.1 201 Created\""} gitlab # [ 424.669220] gitaly[920]: time="2026-09-03T10:33:19.540Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD91VANKE15SAM30YEY92A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:49.438" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:19.538" grpc.time_ms=1.318 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.696636] gitaly[920]: time="2026-09-03T10:33:19.568Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD91BZPZF1X72D75D5BDVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-09-03T10:33:49.466" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:19.566" grpc.time_ms=1.117 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.750851] gitaly[920]: time="2026-09-03T10:33:19.622Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M1KD91VANKE15SAM30YEY92A grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-03T10:33:29.159" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-03T10:33:19.609" grpc.time_ms=12.266 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.774359] gitaly[920]: time="2026-09-03T10:33:19.645Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD91BZPZF1X72D75D5BDVZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:49.543" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:19.644" grpc.time_ms=0.982 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.796709] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:19.667Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"08d5aef8c8d4d4deade16207","created_at":"2026-09-03T10:33:19.202Z","trace_propagation_headers":{"sentry-trace":"dde1416660b7499496257f14b77c7210-4ad643bbe3e4457d","baggage":"sentry-trace_id=dde1416660b7499496257f14b77c7210,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD91BZPZF1X72D75D5BDVZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:19.210Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3415,"job_status":"rescheduled","message":"PipelineProcessWorker JID-08d5aef8c8d4d4deade16207: rescheduled"} gitlab # [ 424.817583] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:19.683Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"08d5aef8c8d4d4deade16207","created_at":"2026-09-03T10:33:19.202Z","trace_propagation_headers":{"sentry-trace":"dde1416660b7499496257f14b77c7210-4ad643bbe3e4457d","baggage":"sentry-trace_id=dde1416660b7499496257f14b77c7210,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M1KD91BZPZF1X72D75D5BDVZ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:19.210Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-08d5aef8c8d4d4deade16207: done: 0.295251 sec","job_status":"done","queue_duration_s":0.17817,"scheduling_latency_s":0.178223,"gitaly_calls":2,"gitaly_duration_s":0.013772,"redis_calls":40,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.015808,"redis_read_bytes":87,"redis_write_bytes":7680,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002029,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001992,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":6,"redis_queues_duration_s":0.002627,"redis_queues_read_bytes":6,"redis_queues_write_bytes":3276,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.003756,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1187,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000533,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.001018,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":29,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":15,"db_ci_count":14,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.005,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.226461,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.20748346,"duration_s":0.295251,"completed_at":"2026-09-03T10:33:19.683Z","load_balancing_strategy":"primary","db_duration_s":0.053205,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 424.874286] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:19.688Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"920e876fc1371928c5cb91f9","created_at":"2026-09-03T10:33:19.529Z","trace_propagation_headers":{"sentry-trace":"dde1416660b7499496257f14b77c7210-dde689a219fd4819","baggage":"sentry-trace_id=dde1416660b7499496257f14b77c7210,sentry-release=Unknown"},"correlation_id":"01M1KD91BZPZF1X72D75D5BDVZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:19.532Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-920e876fc1371928c5cb91f9: start","job_status":"start","queue_duration_s":0.155828,"scheduling_latency_s":0.155862} gitlab # [ 424.890322] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:19.751Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"920e876fc1371928c5cb91f9","created_at":"2026-09-03T10:33:19.529Z","trace_propagation_headers":{"sentry-trace":"dde1416660b7499496257f14b77c7210-dde689a219fd4819","baggage":"sentry-trace_id=dde1416660b7499496257f14b77c7210,sentry-release=Unknown"},"correlation_id":"01M1KD91BZPZF1X72D75D5BDVZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:19.532Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-920e876fc1371928c5cb91f9: done: 0.063399 sec","job_status":"done","queue_duration_s":0.155828,"scheduling_latency_s":0.155862,"redis_calls":7,"redis_duration_s":0.00218,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001562,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000618,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.063399,"completed_at":"2026-09-03T10:33:19.751Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 424.932091] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:19.755Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"f89caa535100e573801c5561","created_at":"2026-09-03T10:33:19.538Z","trace_propagation_headers":{"sentry-trace":"dde1416660b7499496257f14b77c7210-dde689a219fd4819","baggage":"sentry-trace_id=dde1416660b7499496257f14b77c7210,sentry-release=Unknown"},"correlation_id":"01M1KD91BZPZF1X72D75D5BDVZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:19.542Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f89caa535100e573801c5561: start","job_status":"start","queue_duration_s":0.212571,"scheduling_latency_s":0.212601} gitlab # [ 424.947201] nixbot[3458]: {"ts": "2026-09-03T10:33:19.711Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/800a76504cdb0e3a9d9162945e09f3675c861f1a \"HTTP/1.1 201 Created\""} gitlab # [ 424.950042] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/800a76504cdb0e3a9d9162945e09f3675c861f1a HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 240 gitlab # [ 424.952566] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:19.796Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2"],"class":"PipelineMetricsWorker","jid":"f89caa535100e573801c5561","created_at":"2026-09-03T10:33:19.538Z","trace_propagation_headers":{"sentry-trace":"dde1416660b7499496257f14b77c7210-dde689a219fd4819","baggage":"sentry-trace_id=dde1416660b7499496257f14b77c7210,sentry-release=Unknown"},"correlation_id":"01M1KD91BZPZF1X72D75D5BDVZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:0017b95f5c428943017bb18cdb04f3707414ec48b7350aa2a2e06a6849a9ea01","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:19.542Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-f89caa535100e573801c5561: done: 0.041141 sec","job_status":"done","queue_duration_s":0.212571,"scheduling_latency_s":0.212601,"redis_calls":7,"redis_duration_s":0.001618,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00117,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000448,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041141,"completed_at":"2026-09-03T10:33:19.796Z","load_balancing_strategy":"primary","db_duration_s":0.007469,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses gitlab # [ 424.993640] sidekiq-cluster[3415]: {"severity":"INFO","time":"2026-09-03T10:33:19.797Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["2"],"class":"PipelineProcessWorker","jid":"9823b0c97ca4e01dd486799d","created_at":"2026-09-03T10:33:19.668Z","trace_propagation_headers":{"sentry-trace":"dde1416660b7499496257f14b77c7210-dde689a219fd4819","baggage":"sentry-trace_id=dde1416660b7499496257f14b77c7210,sentry-release=Unknown"},"correlation_id":"01M1KD91BZPZF1X72D75D5BDVZ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-09-03T10:33:19.671Z","job_size_bytes":3,"pid":3415,"sidekiq_tid":"m8n3","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-9823b0c97ca4e01dd486799d: start","job_status":"start","queue_duration_s":0.125999,"scheduling_latency_s":0.126023} gitlab # [ 425.092538] gitaly[920]: time="2026-09-03T10:33:19.962Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD91BZPZF1X72D75D5BDVZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:33:19.961" grpc.time_ms=1.012 pid=920 span.kind=server system=grpc gitlab # [ 425.111399] gitaly[920]: time="2026-09-03T10:33:19.978Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M1KD929Q86W0DEGGVH97SCRE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-03T10:33:49.377" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-09-03T10:33:19.977" grpc.time_ms=0.496 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 425.130985] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 98 gitlab # [ 425.133926] gitaly[920]: time="2026-09-03T10:33:19.979Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M1KD9288CGBAX31DM0GPVYHX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-03T10:33:19.970" grpc.time_ms=8.411 pid=920 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses, in 0.14 seconds) (finished: subtest: eval and build post commit statuses, in 9.87 seconds) (finished: run the VM test script, in 497.16 seconds) gitlab # [ 425.150628] gitaly[920]: time="2026-09-03T10:33:19.995Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD91BZPZF1X72D75D5BDVZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-03T10:33:19.994" grpc.time_ms=0.55 pid=920 span.kind=server system=grpc gitlab # [ 425.161474] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/09/03:10:33:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/800a76504cdb0e3a9d9162945e09f3675c861f1a/statuses HTTP/1.1" 200 1334 "" "curl/8.21.0" 86 test script finished in 497.19s cleanup kill QemuMachine (pid 46) gitlab # [ 425.169923] gitaly[920]: time="2026-09-03T10:33:20.034Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M1KD91BZPZF1X72D75D5BDVZ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_tqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14) gitlab # i (finished: cleanup, in 1.46 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-09-03T10:31:38.017Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '800a76504cdb0e3a9d9162945e09f3675c861f1a', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': [{'level': 'warning', 'message': "unable to download 'https://cache.nixos.org/…': Could not resolve hostname (6) Could not resolve host: cache.nixos.org", 'count': 1}], 'error': None, 'created_at': '2026-09-03T10:33:09.114928Z', 'started_at': '2026-09-03T10:33:09.489540Z', 'finished_at': None, 'eval_duration_ms': None, 'eval_queue': None}] [{'id': 5, 'sha': '800a76504cdb0e3a9d9162945e09f3675c861f1a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:33:09.455Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '800a76504cdb0e3a9d9162945e09f3675c861f1a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:33:09.455Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '800a76504cdb0e3a9d9162945e09f3675c861f1a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:33:09.455Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '800a76504cdb0e3a9d9162945e09f3675c861f1a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:33:09.455Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '800a76504cdb0e3a9d9162945e09f3675c861f1a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:33:09.455Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '800a76504cdb0e3a9d9162945e09f3675c861f1a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:33:09.455Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '800a76504cdb0e3a9d9162945e09f3675c861f1a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:33:09.455Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '800a76504cdb0e3a9d9162945e09f3675c861f1a', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'waiting for evaluation', 'created_at': '2026-09-03T10:33:09.455Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '800a76504cdb0e3a9d9162945e09f3675c861f1a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded in 9s (1 warning)', 'created_at': '2026-09-03T10:33:09.455Z', 'started_at': None, 'finished_at': '2026-09-03T10:33:19.188Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '800a76504cdb0e3a9d9162945e09f3675c861f1a', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-09-03T10:33:19.420Z', 'started_at': None, 'finished_at': '2026-09-03T10:33:19.662Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]