tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.n2AXQ5p9Ct', fmt=raw size=1073741824 (finished: start all VMs, in 70.66 seconds) gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab: waiting for unit setup-gitlab.service gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for the VM to finish booting gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab # Filesystem UUID: 26d3eb01-59ce-484e-91bc-0666bdab92ec gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] KASLR enabled gitlab # [ 0.000000] random: crng init done gitlab # [ 0.000000] Machine model: linux,dummy-virt gitlab # [ 0.000000] efi: UEFI not found. gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf] gitlab # [ 0.000000] Zone ranges: gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff] gitlab # [ 0.000000] DMA32 empty gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.000000] Device empty gitlab # [ 0.000000] Movable zone start for each node gitlab # [ 0.000000] Early memory node ranges gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe000000 gitlab # [ 0.000000] psci: probing for conduit method from DT. gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware. gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs gitlab # [ 0.000000] psci: Trusted OS migration not required gitlab # [ 0.000000] psci: SMC Calling Convention v1.1 gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 gitlab # [ 0.000000] Detected PIPT I-cache on CPU0 gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface gitlab # [ 0.000000] CPU features: detected: Spectre-v4 gitlab # [ 0.000000] CPU features: detected: Spectre-BHB gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 gitlab # [ 0.000000] alternatives: applying boot alternatives gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/34pmzpq0fc85sq324r62cx8839nb650b-nixos-system-gitlab-test/init regInfo=/nix/store/7shdgswwbxpn6bf6jfdj0r23j1mvg3lm-closure-info/registration console=ttyAMA0,115200n8 console=tty0 gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/7shdgswwbxpn6bf6jfdj0r23j1mvg3lm-closure-info/registration", will be passed to user space. gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.000000] software IO TLB: area num 4. gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB) gitlab # [ 0.000000] Fallback order for Node 0: 0 gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1572864 gitlab # [ 0.000000] Policy zone: Normal gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.000000] allocated 12582912 bytes of page_ext gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups gitlab # [ 0.000000] rcu: Hierarchical RCU implementation. gitlab # [ 0.000000] rcu: RCU event tracing is enabled. gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.000000] Rude variant of Tasks RCU enabled. gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled. gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 gitlab # [ 0.000000] GICv3: 256 SPIs implemented gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f00000 (indirect, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f10000 (flat, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f20000 gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f30000 gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns gitlab # [ 0.000030] arm-pv: using stolen time PV gitlab # [ 0.000397] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.000592] Console: colour dummy device 80x25 gitlab # [ 0.000599] printk: legacy console [tty0] enabled gitlab # [ 0.000780] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) gitlab # [ 0.000786] pid_max: default: 32768 minimum: 301 gitlab # [ 0.000861] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.000996] landlock: Up and running. gitlab # [ 0.000999] Yama: becoming mindful. gitlab # [ 0.001464] LSM support for eBPF active gitlab # [ 0.001682] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.001792] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.002928] cacheinfo: Unable to detect cache hierarchy for CPU 0 gitlab # [ 0.003641] rcu: Hierarchical SRCU implementation. gitlab # [ 0.003645] rcu: Max phase no-delay instances is 1000. gitlab # [ 0.003787] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.004808] fsl-mc MSI: its@8080000 domain created gitlab # [ 0.004901] EFI services will not be available. gitlab # [ 0.005075] smp: Bringing up secondary CPUs ... gitlab # [ 0.005823] Detected PIPT I-cache on CPU1 gitlab # [ 0.005922] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000 gitlab # [ 0.006044] GICv3: CPU1: using allocated LPI pending table @0x0000000100f40000 gitlab # [ 0.006166] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40] gitlab # [ 0.007292] Detected PIPT I-cache on CPU2 gitlab # [ 0.007396] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000 gitlab # [ 0.007520] GICv3: CPU2: using allocated LPI pending table @0x0000000100f50000 gitlab # [ 0.007644] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40] gitlab # [ 0.008689] Detected PIPT I-cache on CPU3 gitlab # [ 0.008800] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000 gitlab # [ 0.008920] GICv3: CPU3: using allocated LPI pending table @0x0000000100f60000 gitlab # [ 0.009043] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40] gitlab # [ 0.009572] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.009599] SMP: Total of 4 processors activated. gitlab # [ 0.009602] CPU: All CPU(s) started at EL1 gitlab # [ 0.009612] CPU features: detected: Branch Target Identification gitlab # [ 0.009616] CPU features: detected: ARMv8.4 Translation Table Level gitlab # [ 0.009619] CPU features: detected: Instruction cache invalidation not required for I/D coherence gitlab # [ 0.009622] CPU features: detected: Data cache clean to the PoU not required for I/D coherence gitlab # [ 0.009625] CPU features: detected: Common not Private translations gitlab # [ 0.009628] CPU features: detected: CRC32 instructions gitlab # [ 0.009630] CPU features: detected: Data cache clean to Point of Deep Persistence gitlab # [ 0.009634] CPU features: detected: Data cache clean to Point of Persistence gitlab # [ 0.009637] CPU features: detected: Data independent timing control (DIT) gitlab # [ 0.009639] CPU features: detected: E0PD gitlab # [ 0.009641] CPU features: detected: Enhanced Counter Virtualization gitlab # [ 0.009644] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) gitlab # [ 0.009647] CPU features: detected: Enhanced Virtualization Traps gitlab # [ 0.009650] CPU features: detected: Fine Grained Traps gitlab # [ 0.009653] CPU features: detected: Generic authentication (architected QARMA5 algorithm) gitlab # [ 0.009657] CPU features: detected: RCpc load-acquire (LDAPR) gitlab # [ 0.009660] CPU features: detected: LSE atomic instructions gitlab # [ 0.009662] CPU features: detected: Privileged Access Never gitlab # [ 0.009665] CPU features: detected: PMUv3 gitlab # [ 0.009667] CPU features: detected: RAS Extension Support gitlab # [ 0.009669] CPU features: detected: RASv1p1 Extension Support gitlab # [ 0.009672] CPU features: detected: Random Number Generator gitlab # [ 0.009674] CPU features: detected: Speculation barrier (SB) gitlab # [ 0.009676] CPU features: detected: Stage-2 Force Write-Back gitlab # [ 0.009679] CPU features: detected: TLB range maintenance instructions gitlab # [ 0.009683] CPU features: detected: Speculative Store Bypassing Safe (SSBS) gitlab # [ 0.009808] alternatives: applying system-wide alternatives gitlab # [ 0.012706] CPU features: detected: BBM Level 2 without TLB conflict abort gitlab # [ 0.012936] Memory: 5963812K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved) gitlab # [ 0.014355] devtmpfs: initialized gitlab # [ 0.018270] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.018336] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.018533] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL gitlab # [ 0.018537] 0 pages in range for non-PLT usage gitlab # [ 0.018538] 508288 pages in range for PLT usage gitlab # [ 0.018654] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.019406] DMI not present or invalid. gitlab # [ 0.022616] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.025415] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.025699] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.027484] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.027507] audit: initializing netlink subsys (disabled) gitlab # [ 0.027822] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.028294] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.028297] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.028302] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.028305] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.028307] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.028393] cpuidle: using governor ladder gitlab # [ 0.028453] cpuidle: using governor menu gitlab # [ 0.028661] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. gitlab # [ 0.028884] ASID allocator initialised with 65536 entries gitlab # [ 0.029974] Serial: AMBA PL011 UART driver gitlab # [ 0.035088] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 gitlab # [ 0.035380] printk: console [ttyAMA0] enabled gitlab # [ 0.047226] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.047249] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.047259] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages gitlab # [ 0.047267] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page gitlab # [ 0.047275] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.047283] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.047291] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages gitlab # [ 0.047299] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page gitlab # [ 0.059941] fbcon: Taking over console gitlab # [ 0.059968] ACPI: Interpreter disabled. gitlab # [ 0.062774] iommu: Default domain type: Translated gitlab # [ 0.062783] iommu: DMA domain TLB invalidation policy: strict mode gitlab # [ 0.078950] SCSI subsystem initialized gitlab # [ 0.080659] usbcore: registered new interface driver usbfs gitlab # [ 0.080791] usbcore: registered new interface driver hub gitlab # [ 0.080883] usbcore: registered new device driver usb gitlab # [ 0.081819] pps_core: LinuxPPS API ver. 1 registered gitlab # [ 0.081829] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti gitlab # [ 0.081850] PTP clock support registered gitlab # [ 0.081973] EDAC MC: Ver: 3.0.0 gitlab # [ 0.082766] scmi_core: SCMI protocol bus registered gitlab # [ 0.083688] FPGA manager framework gitlab # [ 0.084599] vgaarb: loaded gitlab # [ 0.087856] clocksource: Switched to clocksource arch_sys_counter gitlab # [ 0.093690] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.093770] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.094343] netfs: FS-Cache loaded gitlab # [ 0.094490] pnp: PnP ACPI: disabled gitlab # [ 0.101405] NET: Registered PF_INET protocol family gitlab # [ 0.102684] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.136315] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.136368] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.136415] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.136693] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.137317] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.137422] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.137476] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.137599] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.137819] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.137869] NET: Registered PF_XDP protocol family gitlab # [ 0.137885] PCI: CLS 0 bytes, default 64 gitlab # [ 0.138248] Trying to unpack rootfs image as initramfs... gitlab # [ 0.144609] kvm [1]: HYP mode not available gitlab # [ 0.191735] Initialise system trusted keyrings gitlab # [ 0.192077] workingset: timestamp_bits=42 max_order=21 bucket_order=0 gitlab # [ 0.192789] squashfs: version 4.0 (2009/01/31) Phillip Lougher gitlab # [ 0.192912] 9p: Installing v9fs 9p2000 file system support gitlab # [ 0.204874] Key type asymmetric registered gitlab # [ 0.204878] Asymmetric key parser 'x509' registered gitlab # [ 0.204951] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) gitlab # [ 0.205217] io scheduler mq-deadline registered gitlab # [ 0.205235] io scheduler kyber registered gitlab # [ 0.219891] pl061_gpio 9030000.pl061: PL061 GPIO chip registered gitlab # [ 0.224537] ledtrig-cpu: registered to indicate activity on CPUs gitlab # [ 0.224950] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: gitlab # [ 0.224966] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 gitlab # [ 0.224977] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 gitlab # [ 0.224983] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 gitlab # [ 0.225004] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits gitlab # [ 0.225025] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] gitlab # [ 0.225142] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 gitlab # [ 0.225151] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.225156] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] gitlab # [ 0.225159] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] gitlab # [ 0.225163] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] gitlab # [ 0.225258] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.226060] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.226475] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.226490] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.226544] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.226559] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.227280] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.227666] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.227680] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.227712] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.228440] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.228827] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.228842] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.228898] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.229605] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.229975] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.229989] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.230021] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.230723] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.231126] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.231140] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.231171] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.231953] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.232226] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.232241] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.232283] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.233031] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.233370] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.233384] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.233416] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.233431] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.234149] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint gitlab # [ 0.234496] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.234528] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.235285] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.235711] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.235743] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.236309] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint gitlab # [ 0.236682] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] gitlab # [ 0.237113] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.237581] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] gitlab # [ 0.237596] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.237628] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.238309] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.238671] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.238686] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.238717] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.239582] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned gitlab # [ 0.239590] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned gitlab # [ 0.239594] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned gitlab # [ 0.239648] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned gitlab # [ 0.239730] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned gitlab # [ 0.239824] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned gitlab # [ 0.239907] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned gitlab # [ 0.239968] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned gitlab # [ 0.240019] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned gitlab # [ 0.240072] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned gitlab # [ 0.240126] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned gitlab # [ 0.240184] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned gitlab # [ 0.240254] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned gitlab # [ 0.240305] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned gitlab # [ 0.240326] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned gitlab # [ 0.240348] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned gitlab # [ 0.240370] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned gitlab # [ 0.240392] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned gitlab # [ 0.240413] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned gitlab # [ 0.240435] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned gitlab # [ 0.240456] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned gitlab # [ 0.240479] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned gitlab # [ 0.240500] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned gitlab # [ 0.240523] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned gitlab # [ 0.240552] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned gitlab # [ 0.240585] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned gitlab # [ 0.240606] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned gitlab # [ 0.240627] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned gitlab # [ 0.240648] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned gitlab # [ 0.240669] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned gitlab # [ 0.240690] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned gitlab # [ 0.240711] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned gitlab # [ 0.240733] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned gitlab # [ 0.240754] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned gitlab # [ 0.240780] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] gitlab # [ 0.240787] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] gitlab # [ 0.240791] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] gitlab # [ 0.242792] pci 0000:00:0a.0: enabling device (0000 -> 0002) gitlab # [ 0.275623] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) gitlab # [ 0.281445] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) gitlab # [ 0.287729] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) gitlab # [ 0.294167] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) gitlab # [ 0.300387] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) gitlab # [ 0.307291] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) gitlab # [ 0.313386] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) gitlab # [ 0.319992] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) gitlab # [ 0.325965] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) gitlab # [ 0.332024] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) gitlab # [ 0.338819] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) gitlab # [ 0.354749] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.359387] msm_serial: driver initialized gitlab # [ 0.359763] SuperH (H)SCI(F) driver initialized gitlab # [ 0.359934] STM32 USART driver initialized gitlab # [ 0.401374] loop: module loaded gitlab # [ 0.401888] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 0.406994] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 0.411561] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 0.416638] virtio_blk virtio5: [vdb] 12227672 512-byte logical blocks (6.26 GB/5.83 GiB) gitlab # [ 0.422038] megasas: 07.734.00.00-rc1 gitlab # [ 0.424093] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] gitlab # [ 0.429819] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.429861] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.435126] Using buffer write method gitlab # [ 0.435193] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] gitlab # [ 0.440086] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.440119] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.444841] Using buffer write method gitlab # [ 0.444874] Concatenating MTD devices: gitlab # [ 0.444880] (0): "0.flash" gitlab # [ 0.444886] (1): "0.flash" gitlab # [ 0.444892] into device "0.flash" gitlab # [ 0.608252] Freeing initrd memory: 27184K gitlab # [ 0.625658] tun: Universal TUN/TAP device driver, 1.6 gitlab # [ 0.634089] thunder_xcv, ver 1.0 gitlab # [ 0.634220] thunder_bgx, ver 1.0 gitlab # [ 0.634284] nicpf, ver 1.0 gitlab # [ 0.636091] e1000: Intel(R) PRO/1000 Network Driver gitlab # [ 0.636103] e1000: Copyright (c) 1999-2006 Intel Corporation. gitlab # [ 0.636172] e1000e: Intel(R) PRO/1000 Network Driver gitlab # [ 0.636186] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. gitlab # [ 0.636282] igb: Intel(R) Gigabit Ethernet Network Driver gitlab # [ 0.636292] igb: Copyright (c) 2007-2014 Intel Corporation. gitlab # [ 0.636360] igbvf: Intel(R) Gigabit Virtual Function Network Driver gitlab # [ 0.636370] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. gitlab # [ 0.636806] sky2: driver version 1.30 gitlab # [ 0.641917] usbcore: registered new interface driver usb-storage gitlab # [ 0.642006] ehci-pci 0000:00:0a.0: EHCI Host Controller gitlab # [ 0.642058] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 gitlab # [ 0.642314] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.642360] usbserial: USB Serial support registered for generic gitlab # [ 0.642785] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 gitlab # [ 0.644259] hv_vmbus: registering driver hyperv_keyboard gitlab # [ 0.646612] rtc-pl031 9010000.pl031: registered as rtc0 gitlab # [ 0.646672] rtc-pl031 9010000.pl031: setting system clock to 2026-08-23T07:10:36 UTC (1787469036) gitlab # [ 0.647538] i2c_dev: i2c /dev entries driver gitlab # [ 0.651954] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 gitlab # [ 0.652995] hub 1-0:1.0: USB hub found gitlab # [ 0.653137] hub 1-0:1.0: 6 ports detected gitlab # [ 0.656080] sdhci: Secure Digital Host Controller Interface driver gitlab # [ 0.656095] sdhci: Copyright(c) Pierre Ossman gitlab # [ 0.656904] Synopsys Designware Multimedia Card Interface Driver gitlab # [ 0.657982] sdhci-pltfm: SDHCI platform and OF driver helper gitlab # [ 0.662380] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 0.663206] usbcore: registered new interface driver usbhid gitlab # [ 0.663217] usbhid: USB HID core driver gitlab # [ 0.669120] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available gitlab # [ 0.672927] drop_monitor: Initializing network drop monitor service gitlab # [ 0.673233] NET: Registered PF_INET6 protocol family gitlab # [ 0.674910] Segment Routing with IPv6 gitlab # [ 0.674940] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.675058] NET: Registered PF_PACKET protocol family gitlab # [ 0.675317] 9pnet: Installing 9P2000 support gitlab # [ 0.678881] Key type dns_resolver registered gitlab # [ 0.695436] registered taskstats version 1 gitlab # [ 0.695896] Loading compiled-in X.509 certificates gitlab # [ 0.715197] Demotion targets for Node 0: null gitlab # [ 0.715401] Key type .fscrypt registered gitlab # [ 0.715407] Key type fscrypt-provisioning registered gitlab # [ 0.715574] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 0.715595] ima: Allocated hash algorithm: sha1 gitlab # [ 0.715622] ima: No architecture policies found gitlab # [ 0.716623] input: gpio-keys as /devices/platform/gpio-keys/input/input0 gitlab # [ 0.740855] clk: Disabling unused clocks gitlab # [ 0.740882] PM: genpd: Disabling unused power domains gitlab # [ 0.745610] Freeing unused kernel memory: 4736K gitlab # [ 0.745831] Run /init as init process gitlab # [ 0.778143] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 0.899929] usb 1-1: new high-speed USB device number 2 using ehci-pci gitlab # [ 1.054652] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 gitlab # [ 1.112336] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.112403] systemd[1]: Detected virtualization qemu. gitlab # [ 1.112474] systemd[1]: Detected architecture arm64. gitlab # [ 1.112490] systemd[1]: Running in initrd. gitlab # [ 1.113343] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.113723] systemd[1]: Hostname set to . gitlab # [ 1.200683] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 gitlab # [ 1.319928] usb 1-2: new high-speed USB device number 3 using ehci-pci gitlab # [ 1.350666] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.436006] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.459546] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.459847] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.460067] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.460087] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.460119] systemd[1]: Reached target Path Units. gitlab # [ 1.460141] systemd[1]: Reached target Slice Units. gitlab # [ 1.460162] systemd[1]: Reached target Swaps. gitlab # [ 1.460183] systemd[1]: Reached target Timer Units. gitlab # [ 1.460396] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.460617] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.460820] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.461005] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.461116] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.461141] systemd[1]: Reached target Socket Units. gitlab # [ 1.463328] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.465478] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.465563] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 1.467666] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 1.482516] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 gitlab # [ 1.488245] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 gitlab # [ 1.499334] systemd[1]: Starting Journal Service... gitlab # [ 1.503387] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.503596] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.506689] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 1.516323] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 1.518666] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.524171] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.525008] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 1.529251] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 1.548278] systemd-journald[95]: Collecting audit messages is disabled. gitlab # [ 1.550453] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 1.551280] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 1.551836] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 gitlab # [ 1.552136] [drm] features: -virgl +edid -resource_blob -host_visible gitlab # [ 1.552157] [drm] features: -context_init gitlab # [ 1.553767] [drm] number of scanouts: 1 gitlab # [ 1.553820] [drm] number of cap sets: 0 gitlab # [ 1.555073] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic gitlab # [ 1.555101] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 gitlab # [ 1.563009] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 1.569757] Console: switching to colour frame buffer device 160x50 gitlab # [ 1.570872] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device gitlab # [ 1.576012] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.581879] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.588040] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.594900] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.595620] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.595940] systemd[1]: Reached target Local File Systems. gitlab # [ 1.601153] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.620796] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.643259] systemd[1]: Started Journal Service. gitlab # [ 1.640420] systemd-modules-load[96]: Using 4 probe threads gitlab # [ 1.642770] systemd-modules-load[96]: Module 'virtio_balloon' is built in gitlab # [ 1.645887] systemd-modules-load[96]: Module 'virtio_console' is built in gitlab # [ 1.647544] systemd-modules-load[96]: Module 'virtio_rng' is built in gitlab # [ 1.649067] systemd-modules-load[96]: Inserted module 'dm_mod' gitlab # [ 1.650367] systemd-modules-load[96]: Inserted module 'virtio_gpu' gitlab # [ 1.652067] systemd-udevd[108]: Using default interface naming scheme 'v261'. gitlab # [ 1.653626] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.656965] systemd[1]: Finished Create System Files and Directories. gitlab # [ 1.673232] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 1.703244] systemd[1]: Starting Virtual Console Setup... gitlab # [ 1.756311] systemd-vconsole-setup[131]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 1.761174] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.146325] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.148990] systemd[1]: Reached target System Initialization. gitlab # [ 2.151460] systemd[1]: Reached target Basic System. gitlab # [ 2.337046] (udev-worker)[125]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.357704] (udev-worker)[125]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.359946] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.362283] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.363477] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.370748] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.398885] systemd-fsck[153]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.404170] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.507974] systemd[1]: Mounting /sysroot... gitlab # [ 2.540791] EXT4-fs (vda): mounted filesystem 26d3eb01-59ce-484e-91bc-0666bdab92ec r/w with ordered data mode. Quota mode: none. gitlab # [ 2.539488] systemd[1]: Mounted /sysroot. gitlab # [ 2.541150] systemd[1]: Reached target Initrd Root File System. gitlab # [ 2.542885] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 2.547210] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 2.560119] systemd[1]: Mounting /sysroot/run... gitlab # [ 2.561099] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 2.567361] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 2.572863] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 2.583146] systemd-sysroot-fstab-check[167]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 2.586771] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 2.598770] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 2.599656] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 2.600975] systemd[1]: Mounted /sysroot/run. gitlab # [ 2.601661] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 2.602375] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 2.604510] systemd[1]: Reload requested from client PID 167 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 2.606408] systemd[1]: Reloading... gitlab # [ 2.707102] systemd[1]: Reloading finished in 102 ms. gitlab # [ 2.760311] systemd-sysroot-fstab-check[167]: Requesting initrd-fs.target/start/replace... gitlab # [ 2.761515] systemd-sysroot-fstab-check[167]: Requesting swap.target/start/replace... gitlab # [ 2.764257] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 2.765606] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 2.767224] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 2.768657] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 2.791375] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 2.793233] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 2.885787] (udev-worker)[126]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory gitlab # [ 2.888471] (udev-worker)[126]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory gitlab # [ 2.892346] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 2.893483] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 2.894247] systemd[1]: Stopping Virtual Console Setup... gitlab # [ 2.895072] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.924882] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 2.926037] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 2.926819] systemd[1]: Starting Virtual Console Setup... gitlab # [ 2.951185] systemd-vconsole-setup[195]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.953685] systemd[1]: Finished Virtual Console Setup. gitlab # [ 3.513385] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.582944] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.585337] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.587903] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.590352] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.631943] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.635486] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 3.651709] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.654334] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.656869] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 3.717512] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 3.720298] systemd[1]: Stopped target Basic System. gitlab # [ 3.722480] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 3.724914] systemd[1]: Stopped target Path Units. gitlab # [ 3.727015] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 3.730366] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 3.733705] systemd[1]: Stopped target Slice Units. gitlab # [ 3.735840] systemd[1]: Stopped target Socket Units. gitlab # [ 3.738167] systemd[1]: Stopped target System Initialization. gitlab # [ 3.745296] systemd[1]: Stopped target Swaps. gitlab # [ 3.748974] systemd[1]: Stopped target Timer Units. gitlab # [ 3.751195] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 3.754964] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 3.759129] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 3.762263] systemd[1]: Stopped Find NixOS closure. gitlab # [ 3.764875] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 3.768139] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.772224] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 3.774968] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 3.777174] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 3.779890] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 3.782387] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 3.785724] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 3.788840] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 3.791681] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 3.794304] systemd[1]: Stopped target Local File Systems. gitlab # [ 3.796299] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 3.798604] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 3.801074] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 3.802803] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 3.805132] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.807237] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.809890] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 3.811775] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 3.813754] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 3.815802] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 3.817796] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.820049] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.821737] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 3.823604] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 3.825755] systemd[1]: systemd-udevd.service: Consumed 2.186s CPU time over 2.193s wall clock time, 31.3M memory peak. gitlab # [ 3.828670] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 3.830646] systemd[1]: Closed udev Control Socket. gitlab # [ 3.831993] systemd[1]: Starting Cleanup udev Database... gitlab # [ 3.833505] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 3.835407] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 3.837039] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 3.838994] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 3.840747] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 3.842383] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 3.891705] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 3.895111] systemd[1]: Finished Cleanup udev Database. gitlab # [ 3.897494] systemd[1]: Reached target Switch Root. gitlab # [ 3.899632] systemd[1]: Starting NixOS Activation... gitlab # [ 4.080148] initrd-nixos-activation-start[222]: booting system configuration /nix/store/34pmzpq0fc85sq324r62cx8839nb650b-nixos-system-gitlab-test gitlab # [ 4.140884] initrd-nixos-activation-start[222]: running activation script... gitlab # [ 4.458797] initrd-nixos-activation-start[245]: setting up /etc... gitlab # [ 4.619628] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 4.623142] systemd[1]: Finished NixOS Activation. gitlab # [ 4.625404] systemd[1]: Starting Switch Root... gitlab # [ 4.678395] systemd[1]: Switching root. gitlab # [ 4.804410] systemd-journald[95]: Received SIGTERM from PID 1 (systemd). gitlab # [ 5.449605] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.449746] systemd[1]: Detected virtualization qemu. gitlab # [ 5.449822] systemd[1]: Detected architecture arm64. gitlab # [ 5.449989] systemd[1]: Detected first boot. gitlab # [ 5.451298] systemd[1]: Initializing machine ID from random generator. gitlab # [ 5.805594] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 5.918424] systemd[1]: Applying preset policy. gitlab # [ 6.111323] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 6.267192] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 6.267576] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 6.269946] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 6.279890] systemd[1]: Created slice Slice /system/getty. gitlab # [ 6.283555] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 6.287783] systemd[1]: Created slice User and Session Slice. gitlab # [ 6.289264] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 6.290596] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 6.291703] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 6.292776] systemd[1]: Expecting device /dev/ttyAMA0... gitlab # [ 6.293860] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 6.294945] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 6.295967] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 6.296297] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 6.296579] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 6.296860] systemd[1]: Reached target Path Units. gitlab # [ 6.297112] systemd[1]: Reached target Remote File Systems. gitlab # [ 6.297368] systemd[1]: Reached target Slice Units. gitlab # [ 6.297608] systemd[1]: Reached target Swaps. gitlab # [ 6.298866] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 6.300340] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 6.301585] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 6.302906] systemd[1]: Listening on Factory Reset Management. gitlab # [ 6.303396] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 6.308472] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 6.309830] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 6.314394] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 6.316112] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 6.317293] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.318336] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 6.324764] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 6.326170] systemd[1]: Listening on udev Control Socket. gitlab # [ 6.327552] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 6.384429] systemd[1]: Mounting Huge Pages File System... gitlab # [ 6.389932] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 6.396196] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 6.403552] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 6.410582] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 6.416795] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 6.424140] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 6.434991] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.436191] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 6.437946] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.452158] systemd[1]: Starting Load Kernel Module fuse... gitlab # [ 6.453077] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.465983] systemd[1]: Starting Journal Service... gitlab # [ 6.472100] systemd[1]: Starting Load Kernel Modules... gitlab # [ 6.476154] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 6.484350] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 6.485120] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.495070] fuse: init (API version 7.45) gitlab # [ 6.496022] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 6.511383] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 6.513988] systemd[1]: Mounted Huge Pages File System. gitlab # [ 6.514675] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 6.515370] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 6.517191] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 6.527630] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 6.527898] EXT4-fs (vda): re-mounted 26d3eb01-59ce-484e-91bc-0666bdab92ec. gitlab # [ 6.530578] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 6.534115] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 6.536946] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 6.537692] systemd[1]: modprobe@fuse.service: Deactivated successfully. gitlab # [ 6.538338] systemd[1]: Finished Load Kernel Module fuse. gitlab # [ 6.539130] systemd[1]: Finished Load Kernel Modules. gitlab # [ 6.544367] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 6.545337] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 6.552208] systemd[1]: Mounting FUSE Control File System... gitlab # [ 6.564021] systemd[1]: Starting Firewall... gitlab # [ 6.564470] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 6.577463] systemd-journald[316]: Collecting audit messages is enabled. gitlab # [ 6.588075] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 6.596059] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 6.595259] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 6.597404] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 6.598911] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 6.603727] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 6.604197] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.605947] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 6.600487] systemd-modules-load[317]: Using 3 probe threads[ 6.608318] systemd[1]: Started Journal Service. gitlab # gitlab # [ 6.612368] systemd-modules-load[317]: Module 'atkbd' is built in gitlab # [ 6.614599] systemd-modules-load[317]: Module 'loop' is built in gitlab # [ 6.617719] systemd-modules-load[317]: Inserted module 'tls' gitlab # [ 6.623491] systemd-oomd[318]: No swap; memory pressure usage will be degraded gitlab # [ 6.625327] systemd[1]: Mounted FUSE Control File System. gitlab # [ 6.628105] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 6.630916] systemd[1]: Reached target First Boot Complete. gitlab # [ 6.632305] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 6.646885] systemd-journald[316]: Received client request to flush runtime journal. gitlab # [ 6.671356] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 6.673195] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 6.674420] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 6.675802] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 6.685584] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 6.686509] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 6.688361] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 6.781724] systemd-udevd[367]: Using default interface naming scheme 'v261'. gitlab # [ 6.812662] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 7.046037] systemd[1]: Finished Firewall. gitlab # [ 7.141994] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 7.219605] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 7.296707] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 7.310089] (udev-worker)[416]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.317442] systemd[1]: Mounting /run/wrappers... gitlab # [ 7.335441] (udev-worker)[417]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 7.338871] (udev-worker)[417]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.343782] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. gitlab # [ 7.354226] systemd[1]: Mounted /run/wrappers. gitlab # [ 7.355505] systemd[1]: Reached target Local File Systems. gitlab # [ 7.356616] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 7.360902] systemd[1]: Starting register-nix-paths.service... gitlab # [ 7.362989] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 7.364411] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.384144] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 7.390509] systemd[1]: Starting Create System Files and Directories... gitlab # [ 7.393516] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 7.397016] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 7.403770] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.408480] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 7.412632] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 7.415766] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.418418] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.431771] systemd[1]: Finished Create System Files and Directories. gitlab # [ 7.436653] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 7.439273] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 7.449793] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 7.456716] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 7.475055] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 7.490179] mousedev: PS/2 mouse device common for all mice gitlab # [ 7.502533] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 7.510622] systemd[1]: Starting Update is Completed... gitlab # [ 7.536714] systemd[1]: Finished Update is Completed. gitlab # [ 7.564294] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 7.565508] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 7.566376] systemd[1]: suid-sgid-wrappers.service: Consumed 131ms CPU time over 201ms wall clock time, 6.6M memory peak, 1.9M read from disk. gitlab # [ 7.838541] systemd[1]: Finished register-nix-paths.service. gitlab # [ 7.840419] systemd[1]: Reached target System Initialization. gitlab # [ 7.842167] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 7.843253] systemd[1]: Started logrotate.timer. gitlab # [ 7.843989] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 7.846186] systemd[1]: Reached target Timer Units. gitlab # [ 7.846973] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 7.847887] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 7.861695] systemd[1]: Starting nixbot CI service socket... gitlab # [ 7.862854] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 7.865535] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 7.867389] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 7.869036] systemd[1]: Reached target Socket Units. gitlab # [ 7.900262] dbus-broker-launch[560]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 7.901683] dbus-broker-launch[560]: NSS returned no entry for 'systemd-timesync' gitlab # [ 7.903081] dbus-broker-launch[560]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 7.905455] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 7.918879] dbus-broker-launch[560]: Ready gitlab # [ 7.920813] systemd[1]: Reached target Basic System. gitlab # [ 7.946263] systemd[1]: Started backdoor.service. gitlab # [ 7.948086] systemd[1]: Starting gitlab-config.service... gitlab # [ 7.957178] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 gitlab # connecting to host... gitlab # [ 7.981900] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 7.988312] systemd[1]: Starting Logrotate configuration check... gitlab # [ 7.998685] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab: connected to guest root shell gitlab # [ 8.003916] systemd[1]: Starting Post-Boot Actions... gitlab: (connecting took 8.45 seconds) gitlab # [ 8.005594] systemd[1]: Started Reset console on configuration changes. gitlab: (finished: waiting for the VM to finish booting, in 8.45 seconds) gitlab # [ 8.008515] logrotate[571]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab # [ 8.014111] logrotate[571]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf gitlab # [ 8.015512] logrotate[571]: note: 'monthly' overrides previously specified 'weekly' gitlab # [ 8.020379] logrotate[571]: Reading state from file: /var/lib/logrotate.status gitlab # [ 8.021606] logrotate[571]: state file /var/lib/logrotate.status does not exist gitlab # [ 8.022596] logrotate[571]: Allocating hash table for state file, size 64 entries gitlab # [ 8.023669] logrotate[571]: Handling 4 logs gitlab # [ 8.028259] logrotate[571]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 8.034629] logrotate[571]: considering log /var/log/btmp gitlab # [ 8.035403] logrotate[571]: Creating new state gitlab # [ 8.036155] logrotate[571]: Now: 2026-08-23 07:10 gitlab # [ 8.036900] logrotate[571]: Last rotated at 2026-08-23 07:00 gitlab # [ 8.037757] logrotate[571]: log does not need rotating (log has already been rotated) gitlab # [ 8.038830] logrotate[571]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 8.045646] logrotate[571]: considering log /var/log/wtmp gitlab # [ 8.046456] logrotate[571]: Creating new state gitlab # [ 8.048298] logrotate[571]: Now: 2026-08-23 07:10 gitlab # [ 8.049013] logrotate[571]: Last rotated at 2026-08-23 07:00 gitlab # [ 8.049876] logrotate[571]: log does not need rotating (log has already been rotated) gitlab # [ 8.051692] logrotate[571]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 8.056114] logrotate[571]: switching euid from 0 to 165 and egid from 0 to 165 (pid 571) gitlab # [ 8.057211] logrotate[571]: considering log /var/gitlab/state/log/*.log gitlab # [ 8.058213] logrotate[571]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 8.059261] logrotate[571]: Creating new state gitlab # [ 8.059864] logrotate[571]: switching euid from 165 to 0 and egid from 165 to 0 (pid 571) gitlab # [ 8.061091] logrotate[571]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 8.062714] logrotate[571]: switching euid from 0 to 60 and egid from 0 to 60 (pid 571) gitlab # [ 8.063739] logrotate[571]: considering log /var/log/nginx/*.log gitlab # [ 8.064620] logrotate[571]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 8.065606] logrotate[571]: Creating new state gitlab # [ 8.066246] logrotate[571]: not running postrotate script, since no logs were rotated gitlab # [ 8.067248] logrotate[571]: switching euid from 60 to 0 and egid from 60 to 0 (pid 571) gitlab # [ 8.068496] systemd[1]: Starting resolvconf update... gitlab # [ 8.069589] nsncd[572]: Aug 23 07:10:43.910 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.071753] systemd[1]: Finished Logrotate configuration check. gitlab # [ 8.075598] systemd[1]: Finished Post-Boot Actions. gitlab # [ 8.076509] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.077598] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 8.084837] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.086448] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.092946] systemd[1]: Starting User Login Management... gitlab # [ 8.096073] systemd[1]: Starting Virtual Console Setup... gitlab # [ 8.113274] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 8.115269] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 8.117886] systemd[1]: Starting Virtual Console Setup... gitlab # [ 8.128913] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 8.131725] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 8.132912] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 8.134083] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 8.136330] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 8.137782] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 8.138585] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 8.139465] systemd[1]: nscd.service: Consumed 24ms CPU time over 140ms wall clock time, 7.6M memory peak, 5.8M read from disk. gitlab # [ 8.154178] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 8.159954] systemd-logind[631]: New seat seat0. gitlab # [ 8.163747] systemd-logind[631]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 8.166735] systemd-logind[631]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) gitlab # [ 8.168339] systemd-logind[631]: Watching system buttons on /dev/input/event0 (gpio-keys) gitlab # [ 8.170560] systemd[1]: Started User Login Management. gitlab # [ 8.173458] systemd[1]: Finished resolvconf update. gitlab # [ 8.174952] systemd[1]: Reached target Preparation for Network. gitlab # [ 8.179038] systemd-vconsole-setup[650]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 8.180972] systemd[1]: Starting DHCP Client... gitlab # [ 8.183909] systemd[1]: Starting linger-users.service... gitlab # [ 8.186783] systemd[1]: Starting Address configuration of eth1... gitlab # [ 8.189559] systemd[1]: Starting Extra networking commands.... gitlab # [ 8.196355] nsncd[668]: Aug 23 07:10:44.046 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.198480] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.199592] systemd[1]: Finished Virtual Console Setup. gitlab # [ 8.203753] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.205141] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.210256] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 8.211707] systemd[1]: Finished linger-users.service. gitlab # [ 8.232171] network-addresses-eth1-start[678]: adding address 192.168.1.1/24... done gitlab # [ 8.235712] network-addresses-eth1-start[678]: adding address 2001:db8:1::1/64... done gitlab # [ 8.241967] systemd[1]: Finished Address configuration of eth1. gitlab # [ 8.262212] dhcpcd[697]: dhcpcd-10.3.2 starting gitlab # [ 8.266032] dhcpcd[744]: dev: loaded udev gitlab # [ 8.279008] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 8.279441] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 8.284190] systemd[1]: Finished Extra networking commands.. gitlab # [ 8.287985] systemd[1]: Reached target Network. gitlab # [ 8.288714] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 8.294825] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 8.296174] systemd[1]: Starting Nginx Web Server... gitlab # [ 8.299989] systemd[1]: Starting PostgreSQL Server... gitlab # [ 8.308624] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 8.314765] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 8.312437] systemd[1]: Starting Permit User Sessions... gitlab # [ 8.322487] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 8.322966] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 8.324489] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 8.324804] cfg80211: failed to load regulatory.db gitlab # [ 8.351882] systemd[1]: Finished Permit User Sessions. gitlab # [ 8.355728] systemd[1]: Started Getty on tty1. gitlab # [ 8.356589] systemd[1]: Reached target Login Prompts. gitlab # [ 8.370956] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 8.368274] dhcpcd[744]: eth0: waiting for carrier gitlab # [ 8.370280] dhcpcd[744]: eth0: carrier acquired gitlab # [ 8.378479] dhcpcd[744]: DUID 00:01:00:01:32:1d:59:74:52:54:00:12:34:56 gitlab # [ 8.379491] dhcpcd[744]: eth0: IAID 00:12:34:56 gitlab # [ 8.383224] dhcpcd[744]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 8.463975] nginx-pre-start[794]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok gitlab # [ 8.465888] nginx-pre-start[794]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful gitlab # [ 8.474188] systemd[1]: Started Nginx Web Server. gitlab # [ 8.480833] redis-server[790]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 8.482944] redis-server[790]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 8.484291] redis-server[790]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=790, just started gitlab # [ 8.486471] redis-server[790]: Configuration loaded gitlab # [ 8.487728] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 8.489275] redis[790]: monotonic clock: ARM CNTVCT @ 1000 ticks/us gitlab # [ 8.490699] redis[790]: Running mode=standalone, port=0. gitlab # [ 8.491956] redis[790]: Server initialized gitlab # [ 8.493064] redis[790]: Ready to accept connections unix gitlab # [ 8.494754] redis[790]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 8.500231] postgresql-pre-start[795]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 8.502377] postgresql-pre-start[795]: This user must also own the server process. gitlab # [ 8.503466] postgresql-pre-start[795]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 8.504938] postgresql-pre-start[795]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 8.506259] postgresql-pre-start[795]: The default text search configuration will be set to "english". gitlab # [ 8.507429] postgresql-pre-start[795]: Data page checksums are enabled. gitlab # [ 8.508462] postgresql-pre-start[795]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 8.509872] postgresql-pre-start[795]: creating subdirectories ... ok gitlab # [ 8.510753] postgresql-pre-start[795]: selecting dynamic shared memory implementation ... posix gitlab # [ 8.547231] postgresql-pre-start[795]: selecting default "max_connections" ... 100 gitlab # [ 8.603558] postgresql-pre-start[795]: selecting default "shared_buffers" ... 128MB gitlab # [ 8.896208] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 9.047595] postgresql-pre-start[795]: selecting default time zone ... UTC gitlab # [ 9.051371] postgresql-pre-start[795]: creating configuration files ... ok gitlab # [ 9.114213] gitlab-workhorse[817]: time="2026-08-23T07:10:44Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 9.120580] gitlab-workhorse[817]: time="2026-08-23T07:10:44Z" level=info msg="Using redis/go-redis" gitlab # [ 9.128572] gitlab-workhorse[817]: time="2026-08-23T07:10:44Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 9.293190] postgresql-pre-start[795]: running bootstrap script ... ok gitlab # [ 9.638408] dhcpcd[744]: eth0: soliciting a DHCP lease gitlab # [ 9.653132] dhcpcd[744]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 9.668675] dhcpcd[744]: eth0: probing address 10.0.2.15/24 gitlab # [ 10.035254] postgresql-pre-start[795]: performing post-bootstrap initialization ... ok gitlab # [ 10.314673] postgresql-pre-start[795]: syncing data to disk ... ok gitlab # [ 10.317525] postgresql-pre-start[795]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 10.321485] postgresql-pre-start[795]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 10.328104] postgresql-pre-start[795]: Success. You can now start the database server using: gitlab # [ 10.331516] postgresql-pre-start[795]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 10.489932] postgres[851]: [851] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 10.495570] postgres[851]: [851] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 10.499048] postgres[851]: [851] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 10.503429] postgres[851]: [851] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 10.512418] postgres[860]: [860] LOG: database system was shut down at 2026-08-23 07:10:45 GMT gitlab # [ 10.533416] postgres[851]: [851] LOG: database system is ready to accept connections gitlab # [ 10.539523] systemd[1]: Started PostgreSQL Server. gitlab # [ 10.544333] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 10.660549] dhcpcd[744]: eth0: soliciting an IPv6 router gitlab # [ 10.662939] dhcpcd[744]: eth0: Router Advertisement from fe80::2 gitlab # [ 10.665334] dhcpcd[744]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 10.667653] dhcpcd[744]: eth0: adding route to fec0::/64 gitlab # [ 10.669883] dhcpcd[744]: eth0: adding default route via fe80::2 gitlab # [ 10.753102] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[868]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 10.757474] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[868]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 10.831301] systemd[1]: Finished gitlab-config.service. gitlab # [ 10.838555] systemd[1]: Started gitaly.service. gitlab # [ 10.907566] postgresql-setup-start[876]: CREATE DATABASE gitlab # [ 10.970766] postgresql-setup-start[895]: CREATE ROLE gitlab # [ 11.003500] postgresql-setup-start[897]: ALTER DATABASE gitlab # [ 11.063254] postgresql-setup-start[902]: CREATE ROLE gitlab # [ 11.068696] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 11.071117] systemd[1]: Reached target PostgreSQL. gitlab # [ 11.075845] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 11.082191] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 11.309211] gitlab-postgresql-start[918]: CREATE DATABASE gitlab # [ 11.371847] gitlab-postgresql-start[927]: CREATE EXTENSION gitlab # [ 11.456511] gitlab-postgresql-start[934]: CREATE EXTENSION gitlab # [ 11.458810] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 11.553267] gitaly[890]: time="2026-08-23T07:10:47.409Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=890 gitlab # [ 11.572388] gitaly[890]: time="2026-08-23T07:10:47.410Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=890 gitlab # [ 11.574836] gitaly[890]: time="2026-08-23T07:10:47.410Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=890 gitlab # [ 11.578006] gitaly[890]: time="2026-08-23T07:10:47.410Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=890 gitlab # [ 11.580428] gitaly[890]: time="2026-08-23T07:10:47.410Z" level=info msg="Starting Gitaly" pid=890 version= gitlab # [ 11.776746] gitaly[890]: time="2026-08-23T07:10:47.633Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=222 pid=890 gitlab # [ 11.778680] gitaly[890]: time="2026-08-23T07:10:47.633Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=890 gitlab # [ 11.780307] gitaly[890]: time="2026-08-23T07:10:47.634Z" level=info msg="finished initializing command factory" duration_ms=0 pid=890 gitlab # [ 11.782176] gitaly[890]: time="2026-08-23T07:10:47.634Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-890/git-exec-716234609.d/git pid=890 gitlab # [ 11.784065] gitaly[890]: time="2026-08-23T07:10:47.639Z" level=info msg="finished detecting git version" duration_ms=5 pid=890 gitlab # [ 11.785780] gitaly[890]: time="2026-08-23T07:10:47.640Z" level=info msg="using Git version" pid=890 version=2.53.g gitlab # [ 11.787411] gitaly[890]: time="2026-08-23T07:10:47.640Z" level=info msg="clearing disk cache object folder" pid=890 storage=default gitlab # [ 11.789108] gitaly[890]: time="2026-08-23T07:10:47.640Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3687207168 pid=890 storage=default gitlab # [ 11.791748] gitaly[890]: time="2026-08-23T07:10:47.640Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3687207168 pid=890 storage=default gitlab # [ 11.795248] gitaly[890]: time="2026-08-23T07:10:47.640Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=890 gitlab # [ 11.798083] gitaly[890]: time="2026-08-23T07:10:47.640Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=890 gitlab # [ 11.801090] gitaly[890]: time="2026-08-23T07:10:47.640Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache3687207168 clear_duration_ms=0 pid=890 storage=default gitlab # [ 11.805080] gitaly[890]: time="2026-08-23T07:10:47.662Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=890 gitlab # [ 11.807128] gitaly[890]: time="2026-08-23T07:10:47.662Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=890 schema=unix gitlab # [ 11.809088] gitaly[890]: time="2026-08-23T07:10:47.662Z" level=info msg="listening at address" address=/run/gitaly/gitaly-890/sock.d/intern pid=890 schema=unix gitlab # [ 11.811011] gitaly[890]: time="2026-08-23T07:10:47.663Z" level=info msg="finished tempdir cleaner walk" pid=890 storage=default time_ms=0 gitlab # [ 11.812589] gitaly[890]: time="2026-08-23T07:10:47.663Z" level=info msg="counting repositories" pid=890 gitlab # [ 11.813770] gitaly[890]: time="2026-08-23T07:10:47.663Z" level=info msg="starting to count repositories" pid=890 storage_path=/var/gitlab/state/repositories gitlab # [ 11.815479] gitaly[890]: time="2026-08-23T07:10:47.663Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=890 storage_path=/var/gitlab/state/repositories gitlab # [ 11.817599] gitaly[890]: time="2026-08-23T07:10:47.663Z" level=info msg="completed counting all repositories" counting_duration=0 pid=890 gitlab # [ 11.819115] gitaly[890]: time="2026-08-23T07:10:47.663Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=890 gitlab # [ 11.821850] gitaly[890]: time="2026-08-23T07:10:47.663Z" level=info msg="Started Gitaly" duration_ms=253 pid=890 gitlab # [ 11.823111] gitaly[890]: time="2026-08-23T07:10:47.663Z" level=info msg="maintenance: daily scheduled" pid=890 scheduled="2026-08-23 12:00:00 +0000 UTC" gitlab # [ 11.824880] gitaly[890]: time="2026-08-23T07:10:47.664Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=890 gitlab # [ 12.520438] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[912]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.520822] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[912]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 12.535906] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[912]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 14.833188] dhcpcd[744]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 14.833513] dhcpcd[744]: eth0: adding route to 10.0.2.0/24 gitlab # [ 14.833669] dhcpcd[744]: eth0: adding default route via 10.0.2.2 gitlab # [ 15.033071] systemd[1]: Started DHCP Client. gitlab # [ 15.036671] systemd[1]: Reached target Network is Online. gitlab # [ 15.406410] gitaly[890]: time="2026-08-23T07:10:51.262Z" level=info msg="License database preloaded" duration_ms=3852 pid=890 gitlab # [ 56.184274] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[912]: W, [2026-08-23T07:11:32.040697 #912] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 59.179782] gitlab-workhorse[817]: time="2026-08-23T07:11:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 59.269373] postgres[1424]: [1424] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 59.273169] postgres[1424]: [1424] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 59.276852] postgres[1424]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 59.280765] postgres[1424]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 59.284270] postgres[1424]: attidentity AS identity, gitlab # [ 59.286571] postgres[1424]: attgenerated as attgenerated gitlab # [ 59.289134] postgres[1424]: FROM pg_attribute a gitlab # [ 59.291112] postgres[1424]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 59.294788] postgres[1424]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 59.297614] postgres[1424]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 59.301868] postgres[1424]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 59.304748] postgres[1424]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 59.307415] postgres[1424]: ORDER BY a.attnum gitlab # [ 59.309403] postgres[1424]: gitlab # [ 64.371230] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1475]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 64.371528] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1475]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 69.190186] gitlab-workhorse[817]: time="2026-08-23T07:11:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 79.191910] gitlab-workhorse[817]: time="2026-08-23T07:11:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 89.192814] gitlab-workhorse[817]: time="2026-08-23T07:12:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 90.407815] postgres[1569]: [1569] ERROR: relation "table_without_models" does not exist gitlab # [ 90.408262] postgres[1569]: [1569] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 99.202623] gitlab-workhorse[817]: time="2026-08-23T07:12:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 109.210920] gitlab-workhorse[817]: time="2026-08-23T07:12:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 119.212098] gitlab-workhorse[817]: time="2026-08-23T07:12:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 121.623886] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 121.629202] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 121.635440] systemd[1]: Starting gitlab.service... gitlab # [ 122.170743] bundle[1962]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 122.177156] bundle[1962]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 122.182981] bundle[1962]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 126.902191] sidekiq-cluster[1961]: {"severity":"INFO","time":"2026-08-23T07:12:42.717Z","message":"Starting cluster with 1 processes"} gitlab # [ 127.054866] bundle[1962]: {"timestamp":"2026-08-23T07:12:42.875Z","pid":1962,"message":"* Enabling systemd notification integration"} gitlab # [ 127.060065] bundle[1962]: {"timestamp":"2026-08-23T07:12:42.911Z","pid":1962,"message":"Puma starting in cluster mode..."} gitlab # [ 127.064446] bundle[1962]: {"timestamp":"2026-08-23T07:12:42.911Z","pid":1962,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 127.069161] bundle[1962]: {"timestamp":"2026-08-23T07:12:42.911Z","pid":1962,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 127.075179] bundle[1962]: {"timestamp":"2026-08-23T07:12:42.911Z","pid":1962,"message":"* Min threads: 0"} gitlab # [ 127.079276] bundle[1962]: {"timestamp":"2026-08-23T07:12:42.911Z","pid":1962,"message":"* Max threads: 4"} gitlab # [ 127.083392] bundle[1962]: {"timestamp":"2026-08-23T07:12:42.911Z","pid":1962,"message":"* Environment: production"} gitlab # [ 127.087742] bundle[1962]: {"timestamp":"2026-08-23T07:12:42.911Z","pid":1962,"message":"* Master PID: 1962"} gitlab # [ 127.091859] bundle[1962]: {"timestamp":"2026-08-23T07:12:42.911Z","pid":1962,"message":"* Workers: 2"} gitlab # [ 127.095958] bundle[1962]: {"timestamp":"2026-08-23T07:12:42.911Z","pid":1962,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 127.100961] bundle[1962]: {"timestamp":"2026-08-23T07:12:42.911Z","pid":1962,"message":"* Preloading application"} gitlab # [ 129.216959] gitlab-workhorse[817]: time="2026-08-23T07:12:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 139.215288] gitlab-workhorse[817]: time="2026-08-23T07:12:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 149.225652] gitlab-workhorse[817]: time="2026-08-23T07:13:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 159.226736] gitlab-workhorse[817]: time="2026-08-23T07:13:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 165.992472] bundle[1962]: W, [2026-08-23T07:13:21.848276 #1962] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 169.233535] gitlab-workhorse[817]: time="2026-08-23T07:13:25Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 169.458390] sidekiq-cluster[2005]: 2026-08-23T07:13:25.314Z pid=2005 tid=wot INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2005, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431853568} gitlab # [ 169.745272] sidekiq-cluster[2005]: W, [2026-08-23T07:13:25.602219 #2005] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 169.813116] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:25.670Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 173.581569] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.437Z","message":"GitLab reliable fetch activated!"} gitlab # [ 173.581966] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.437Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 173.629278] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.486Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 173.636322] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.490Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 173.643307] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.494Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 173.649974] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.497Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 173.657440] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.501Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 173.664188] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.504Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 173.670204] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.506Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 173.675171] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.508Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 173.679813] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.511Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 173.684196] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.513Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 173.688556] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.515Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 173.692484] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.518Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 173.695869] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.521Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 173.699601] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.523Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 173.703121] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.526Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 173.706478] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.529Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 173.709506] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.532Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 173.712269] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.534Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 173.715160] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.537Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 173.718029] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.540Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 173.720994] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.543Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 173.723878] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.545Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 173.726585] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.547Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 173.730275] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.549Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 173.732868] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.552Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 173.735253] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.555Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 173.737731] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.558Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 173.740148] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.561Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 173.742601] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.564Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 173.745245] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.566Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 173.747554] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.569Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 173.750334] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.572Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 173.752736] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.574Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 173.755240] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.577Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 173.757825] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.580Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 173.760260] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.582Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 173.762655] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.584Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 173.765012] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.587Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 173.767290] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.589Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 173.769720] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.591Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 173.772220] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.593Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 173.774718] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.595Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 173.777299] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.597Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 173.779661] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.599Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 173.782286] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.602Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 173.784836] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.604Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 173.787113] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.606Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 173.789537] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.608Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 173.791793] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.610Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 173.794181] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.612Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 173.796398] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.615Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 173.798476] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.617Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 173.800631] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.630Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 173.802914] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.632Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 173.805131] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.635Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 173.807220] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.637Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 173.809453] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.639Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 173.811653] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.642Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 173.814011] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.644Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 173.816214] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.646Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 173.818199] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.648Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 173.820169] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.650Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 173.822177] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.652Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 173.824294] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.655Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 173.826400] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.657Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 173.828521] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.660Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 173.830525] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.662Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 173.832711] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.663Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 173.834953] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.665Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 173.837338] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.667Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 173.839512] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.669Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 173.841856] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.670Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 173.844133] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.672Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 173.846730] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.674Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 173.849138] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.675Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 173.851429] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.677Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 173.853770] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.679Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 173.856215] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.681Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 173.858435] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.683Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 173.860609] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.684Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 173.862892] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.686Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 173.865515] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.688Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 173.867738] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.691Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 173.870103] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.692Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 173.872364] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.697Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 173.874454] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.710Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 173.876755] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.713Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 173.878883] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.715Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 173.881228] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.718Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 173.883446] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.722Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 173.885853] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.725Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 173.888079] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.731Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 173.890325] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.738Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 173.892796] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.740Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 173.894757] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.743Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 173.897172] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.746Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 173.899381] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.748Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 173.901738] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.750Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 173.906676] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.763Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 173.908964] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.765Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 173.911067] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.767Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 173.913757] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.770Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 173.916616] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.773Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 173.919025] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.776Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 173.921655] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.778Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 173.923949] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.780Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 173.926247] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.782Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 173.973049] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.830Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 173.977018] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:13:29.832Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 179.244463] gitlab-workhorse[817]: time="2026-08-23T07:13:35Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 189.247619] gitlab-workhorse[817]: time="2026-08-23T07:13:45Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 199.257648] gitlab-workhorse[817]: time="2026-08-23T07:13:55Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 209.266205] gitlab-workhorse[817]: time="2026-08-23T07:14:05Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 212.753621] postgres[2731]: [2731] ERROR: relation "table_without_models" does not exist gitlab # [ 212.757207] postgres[2731]: [2731] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 215.819297] postgres[2761]: [2761] ERROR: relation "table_without_models" does not exist gitlab # [ 215.822904] postgres[2761]: [2761] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 217.732506] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:13.588Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 217.735173] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:13.592Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 217.742926] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:13.594Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 217.748652] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:13.594Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 217.754670] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:13.596Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 219.269058] gitlab-workhorse[817]: time="2026-08-23T07:14:15Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 220.385379] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:16.241Z","message":"Cleaning working queues"} gitlab # [ 220.388160] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:16.244Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"78c7e12ea3b459306b2834e9","created_at":"2026-08-23T07:12:36.960Z","trace_propagation_headers":{"sentry-trace":"619acfcf15f24027a9abfc027c5f7289-36119abcd35e4484","baggage":"sentry-trace_id=619acfcf15f24027a9abfc027c5f7289,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"288cc242205e62fc177e4965c42edb79","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:36.972Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-78c7e12ea3b459306b2834e9: start","job_status":"start","queue_duration_s":99.271107,"scheduling_latency_s":99.271207} gitlab # [ 220.804274] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:16.659Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"78c7e12ea3b459306b2834e9","created_at":"2026-08-23T07:12:36.960Z","trace_propagation_headers":{"sentry-trace":"619acfcf15f24027a9abfc027c5f7289-36119abcd35e4484","baggage":"sentry-trace_id=619acfcf15f24027a9abfc027c5f7289,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"288cc242205e62fc177e4965c42edb79","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T07:12:36.972Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-78c7e12ea3b459306b2834e9: done: 0.416291 sec","job_status":"done","queue_duration_s":99.271107,"scheduling_latency_s":99.271207,"redis_calls":29,"redis_duration_s":0.012667,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007635,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003211,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001821,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.202538,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19016666,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.416291,"completed_at":"2026-08-23T07:14:16.659Z","load_balancing_strategy":"primary","db_duration_s":0.092317,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 221.458748] bundle[1962]: {"timestamp":"2026-08-23T07:14:17.314Z","pid":1962,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 221.464629] bundle[1962]: {"timestamp":"2026-08-23T07:14:17.314Z","pid":1962,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 221.469721] bundle[1962]: {"timestamp":"2026-08-23T07:14:17.314Z","pid":1962,"message":"! #\u003cThread:0x0000f4adf2925938 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 221.485243] bundle[1962]: {"timestamp":"2026-08-23T07:14:17.314Z","pid":1962,"message":"! #\u003cThread:0x0000f4adf2b33108 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 221.502192] bundle[1962]: {"timestamp":"2026-08-23T07:14:17.315Z","pid":1962,"message":"Use Ctrl-C to stop"} gitlab # [ 221.506143] bundle[1962]: {"timestamp":"2026-08-23T07:14:17.315Z","pid":1962,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 222.483763] bundle[1962]: {"timestamp":"2026-08-23T07:14:18.339Z","pid":1962,"message":"- Worker 1 (PID: 2873) booted in 0.97s, phase: 0"} gitlab # [ 222.489087] bundle[1962]: {"timestamp":"2026-08-23T07:14:18.340Z","pid":1962,"message":"- Worker 0 (PID: 2869) booted in 0.99s, phase: 0"} gitlab # [ 222.494984] systemd[1]: Started gitlab.service. gitlab # [ 222.497236] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 222.502602] systemd[1]: Starting setup-gitlab.service... gitlab # [ 222.540381] setup-gitlab-start[2906]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 225.877252] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:14:21 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 3289 gitlab # [ 225.883694] setup-gitlab-start[2906]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 225.887322] setup-gitlab-start[2906]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 225.904409] runuser[2928]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 226.460699] setup-gitlab-start[2929]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 226.461014] setup-gitlab-start[2929]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 226.462676] setup-gitlab-start[2929]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 227.277908] setup-gitlab-start[2929]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 227.284435] setup-gitlab-start[2929]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 227.290595] setup-gitlab-start[2929]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 234.545624] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:30.401Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"0468583e43f4b2b4dcd3b3ae","created_at":"2026-08-23T07:14:30.291Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51708e0c90afb406736b8621f09c8c08","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.397Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-0468583e43f4b2b4dcd3b3ae: start","job_status":"start","queue_duration_s":0.003552,"scheduling_latency_s":0.00361} gitlab # [ 234.842259] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:30.696Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"0468583e43f4b2b4dcd3b3ae","created_at":"2026-08-23T07:14:30.291Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"51708e0c90afb406736b8621f09c8c08","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.397Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-0468583e43f4b2b4dcd3b3ae: done: 0.295812 sec","job_status":"done","queue_duration_s":0.003552,"scheduling_latency_s":0.00361,"redis_calls":12,"redis_duration_s":0.024795,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003861,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015952,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004982,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00193192,"exclusive_lock_hold_duration_s":0.08112432,"duration_s":0.295812,"completed_at":"2026-08-23T07:14:30.696Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.097395,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 234.941987] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:30.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"9f4cb276075f21f7dd27935c","created_at":"2026-08-23T07:14:30.453Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5fb7c3ab4e126622950959e7ea48f6d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.467Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-9f4cb276075f21f7dd27935c: start","job_status":"start","queue_duration_s":0.25279,"scheduling_latency_s":0.252834} gitlab # [ 235.220115] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:31.075Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"9f4cb276075f21f7dd27935c","created_at":"2026-08-23T07:14:30.453Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5fb7c3ab4e126622950959e7ea48f6d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.467Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-9f4cb276075f21f7dd27935c: done: 0.355 sec","job_status":"done","queue_duration_s":0.25279,"scheduling_latency_s":0.252834,"redis_calls":12,"redis_duration_s":0.028693,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009445,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.018793,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.064,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.064,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.118303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.01728494,"exclusive_lock_hold_duration_s":0.23383638,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.355,"completed_at":"2026-08-23T07:14:31.075Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.069639,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.313192] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:31.094Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"60faec66c41ac32a84e85a2e","created_at":"2026-08-23T07:14:30.474Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d56cb1aaeee74fb250527b2f4f777cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T07:14:30.500Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-60faec66c41ac32a84e85a2e: start","job_status":"start","queue_duration_s":0.593824,"scheduling_latency_s":0.593872} gitlab # [ 235.328793] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:31.125Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 235.332787] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:31.173Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"60faec66c41ac32a84e85a2e","created_at":"2026-08-23T07:14:30.474Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d56cb1aaeee74fb250527b2f4f777cb6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T07:14:30.500Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-60faec66c41ac32a84e85a2e: done: 0.079474 sec","job_status":"done","queue_duration_s":0.593824,"scheduling_latency_s":0.593872,"redis_calls":10,"redis_duration_s":0.004571,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000932,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002464,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001175,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030109,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065954,"duration_s":0.079474,"completed_at":"2026-08-23T07:14:31.173Z","load_balancing_strategy":"primary","db_duration_s":0.000968,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.375080] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:31.190Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"38a8a0c4826fb3d2a4573ebc","created_at":"2026-08-23T07:14:30.531Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.543Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-38a8a0c4826fb3d2a4573ebc: start","job_status":"start","queue_duration_s":0.646735,"scheduling_latency_s":0.646786} gitlab # [ 235.743784] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:31.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"38a8a0c4826fb3d2a4573ebc","created_at":"2026-08-23T07:14:30.531Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.543Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-38a8a0c4826fb3d2a4573ebc: done: 0.40932 sec","job_status":"done","queue_duration_s":0.646735,"scheduling_latency_s":0.646786,"redis_calls":71,"redis_duration_s":0.12608,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.038992,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001029,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.084008,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002051,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.206735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037456,"duration_s":0.40932,"completed_at":"2026-08-23T07:14:31.599Z","load_balancing_strategy":"primary","db_duration_s":0.011923,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 235.845662] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:31.601Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"670c78c221f6c3b5640cb1d7","created_at":"2026-08-23T07:14:30.558Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2cc1bb21162b31d6d5dca692aee69da","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.582Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-670c78c221f6c3b5640cb1d7: start","job_status":"start","queue_duration_s":1.018962,"scheduling_latency_s":1.018987} gitlab # [ 236.153278] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.009Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"670c78c221f6c3b5640cb1d7","created_at":"2026-08-23T07:14:30.558Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2cc1bb21162b31d6d5dca692aee69da","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.582Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-670c78c221f6c3b5640cb1d7: done: 0.408534 sec","job_status":"done","queue_duration_s":1.018962,"scheduling_latency_s":1.018987,"redis_calls":565,"redis_duration_s":0.105311,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000564,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00142,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.103327,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.342714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003405,"duration_s":0.408534,"completed_at":"2026-08-23T07:14:32.009Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.255226] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.011Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"a3b7e183f376ce70fbc5a103","created_at":"2026-08-23T07:14:30.641Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57aa43bab412f38e2ae61e9e9be05a0c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T07:14:30.655Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-a3b7e183f376ce70fbc5a103: start","job_status":"start","queue_duration_s":1.356187,"scheduling_latency_s":1.356207} gitlab # [ 236.273068] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.024Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 236.276917] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"a3b7e183f376ce70fbc5a103","created_at":"2026-08-23T07:14:30.641Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"57aa43bab412f38e2ae61e9e9be05a0c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T07:14:30.655Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-a3b7e183f376ce70fbc5a103: done: 0.02087 sec","job_status":"done","queue_duration_s":1.356187,"scheduling_latency_s":1.356207,"redis_calls":10,"redis_duration_s":0.002444,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000564,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003279,"duration_s":0.02087,"completed_at":"2026-08-23T07:14:32.032Z","load_balancing_strategy":"primary","db_duration_s":0.000898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.319939] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.034Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f7cc85ab1ceb71a5fbf2f56b","created_at":"2026-08-23T07:14:30.682Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce6cab624ff47fafbeafdff9eb90b0e3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.700Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f7cc85ab1ceb71a5fbf2f56b: start","job_status":"start","queue_duration_s":1.333531,"scheduling_latency_s":1.333549} gitlab # [ 236.334414] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.053Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 236.338033] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.071Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f7cc85ab1ceb71a5fbf2f56b","created_at":"2026-08-23T07:14:30.682Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce6cab624ff47fafbeafdff9eb90b0e3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.700Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f7cc85ab1ceb71a5fbf2f56b: done: 0.037348 sec","job_status":"done","queue_duration_s":1.333531,"scheduling_latency_s":1.333549,"redis_calls":10,"redis_duration_s":0.002611,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000682,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001421,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000508,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023515,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005213,"duration_s":0.037348,"completed_at":"2026-08-23T07:14:32.071Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.380139] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.074Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"1a13f67bddc5a99535fa058f","created_at":"2026-08-23T07:14:30.718Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54cc3e4e452142fcbf65f7fdac48e775","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.759Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-1a13f67bddc5a99535fa058f: start","job_status":"start","queue_duration_s":1.315345,"scheduling_latency_s":1.315391} gitlab # [ 236.395445] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.138Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"1a13f67bddc5a99535fa058f","created_at":"2026-08-23T07:14:30.718Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"54cc3e4e452142fcbf65f7fdac48e775","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.759Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-1a13f67bddc5a99535fa058f: done: 0.063811 sec","job_status":"done","queue_duration_s":1.315345,"scheduling_latency_s":1.315391,"redis_calls":13,"redis_duration_s":0.005115,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000852,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002497,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001766,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01842142,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.063811,"completed_at":"2026-08-23T07:14:32.138Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00555,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 236.439686] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.140Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9838cebb4172b52f91b078f0","created_at":"2026-08-23T07:14:30.787Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f9f183e5edc4faa6e4498d7ebee09e4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T07:14:30.800Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9838cebb4172b52f91b078f0: start","job_status":"start","queue_duration_s":1.340485,"scheduling_latency_s":1.340509} gitlab # [ 236.452772] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9838cebb4172b52f91b078f0","created_at":"2026-08-23T07:14:30.787Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f9f183e5edc4faa6e4498d7ebee09e4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T07:14:30.800Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9838cebb4172b52f91b078f0: done: 0.050935 sec","job_status":"done","queue_duration_s":1.340485,"scheduling_latency_s":1.340509,"redis_calls":10,"redis_duration_s":0.003304,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000848,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001791,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000665,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03089,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046786,"duration_s":0.050935,"completed_at":"2026-08-23T07:14:32.191Z","load_balancing_strategy":"primary","db_duration_s":0.008792,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.493554] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.193Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d3d82574e96d5a5356d76d94","created_at":"2026-08-23T07:14:30.812Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94b1e7977bb4fd1ee2f91432b7eadb7c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.865Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d3d82574e96d5a5356d76d94: start","job_status":"start","queue_duration_s":1.327956,"scheduling_latency_s":1.32798} gitlab # [ 236.508056] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.209Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 236.511127] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.219Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d3d82574e96d5a5356d76d94","created_at":"2026-08-23T07:14:30.812Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94b1e7977bb4fd1ee2f91432b7eadb7c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.865Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d3d82574e96d5a5356d76d94: done: 0.02573 sec","job_status":"done","queue_duration_s":1.327956,"scheduling_latency_s":1.32798,"redis_calls":10,"redis_duration_s":0.0028599999999999997,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000664,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001653,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004084,"duration_s":0.02573,"completed_at":"2026-08-23T07:14:32.219Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000738,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.553442] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.221Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"4bde83aa2a5a5ae92d31b899","created_at":"2026-08-23T07:14:30.903Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d69974c2d266f5a22da26e0fe1858bf","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.913Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-4bde83aa2a5a5ae92d31b899: start","job_status":"start","queue_duration_s":1.30775,"scheduling_latency_s":1.307772} gitlab # [ 236.567339] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.278Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"4bde83aa2a5a5ae92d31b899","created_at":"2026-08-23T07:14:30.903Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5d69974c2d266f5a22da26e0fe1858bf","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.913Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-4bde83aa2a5a5ae92d31b899: done: 0.057612 sec","job_status":"done","queue_duration_s":1.30775,"scheduling_latency_s":1.307772,"redis_calls":10,"redis_duration_s":0.003124,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000542,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001952,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00063,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063722,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.057612,"completed_at":"2026-08-23T07:14:32.278Z","load_balancing_strategy":"primary","db_duration_s":0.026763,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.610633] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.281Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ac6b388572565da153de2494","created_at":"2026-08-23T07:14:30.944Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ce84efadab6047d3bdb4b4473fac2f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.952Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ac6b388572565da153de2494: start","job_status":"start","queue_duration_s":1.328512,"scheduling_latency_s":1.32854} gitlab # [ 236.625212] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.299Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 236.628843] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.309Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"ac6b388572565da153de2494","created_at":"2026-08-23T07:14:30.944Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ce84efadab6047d3bdb4b4473fac2f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.952Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-ac6b388572565da153de2494: done: 0.028104 sec","job_status":"done","queue_duration_s":1.328512,"scheduling_latency_s":1.32854,"redis_calls":10,"redis_duration_s":0.00314,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000647,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001879,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000614,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016317,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00064684,"duration_s":0.028104,"completed_at":"2026-08-23T07:14:32.309Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00078,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.671028] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.311Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"79b63cac94b0d4e7c5534ea1","created_at":"2026-08-23T07:14:30.962Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4bf1fb5db65eb9f1116b7a6d17d150a3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.969Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-79b63cac94b0d4e7c5534ea1: start","job_status":"start","queue_duration_s":1.342161,"scheduling_latency_s":1.342184} gitlab # [ 236.685829] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.340Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"79b63cac94b0d4e7c5534ea1","created_at":"2026-08-23T07:14:30.962Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4bf1fb5db65eb9f1116b7a6d17d150a3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.969Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-79b63cac94b0d4e7c5534ea1: done: 0.028891 sec","job_status":"done","queue_duration_s":1.342161,"scheduling_latency_s":1.342184,"redis_calls":12,"redis_duration_s":0.003594,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001129,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001658,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017373,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042654,"duration_s":0.028891,"completed_at":"2026-08-23T07:14:32.340Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001285,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.728006] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.342Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a331fa74d0f27af7a66e7fe6","created_at":"2026-08-23T07:14:30.979Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ce61791bbe6495060fe8e16e1db5681","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.986Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a331fa74d0f27af7a66e7fe6: start","job_status":"start","queue_duration_s":1.355436,"scheduling_latency_s":1.355454} gitlab # [ 236.742379] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.363Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"a331fa74d0f27af7a66e7fe6","created_at":"2026-08-23T07:14:30.979Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3ce61791bbe6495060fe8e16e1db5681","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:30.986Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-a331fa74d0f27af7a66e7fe6: done: 0.021785 sec","job_status":"done","queue_duration_s":1.355436,"scheduling_latency_s":1.355454,"redis_calls":10,"redis_duration_s":0.002418,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000516,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001372,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00053,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012429,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034824,"duration_s":0.021785,"completed_at":"2026-08-23T07:14:32.363Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000843,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.784816] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.365Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5866243b13c1e123de5c7923","created_at":"2026-08-23T07:14:31.004Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6af102931981b4eed10fc9904a7ace92","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.020Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5866243b13c1e123de5c7923: start","job_status":"start","queue_duration_s":1.345354,"scheduling_latency_s":1.345373} gitlab # [ 236.798903] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.405Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5866243b13c1e123de5c7923","created_at":"2026-08-23T07:14:31.004Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6af102931981b4eed10fc9904a7ace92","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.020Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5866243b13c1e123de5c7923: done: 0.039453 sec","job_status":"done","queue_duration_s":1.345354,"scheduling_latency_s":1.345373,"redis_calls":19,"redis_duration_s":0.004874,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001086,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000357,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002565,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000866,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02623,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032658,"duration_s":0.039453,"completed_at":"2026-08-23T07:14:32.405Z","load_balancing_strategy":"primary","db_duration_s":0.003609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.841495] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.406Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"4f12c05b9019d3ffed3285bb","created_at":"2026-08-23T07:14:31.025Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19b98a3fb2ac0aac2eeaaf0099d83fc9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.039Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-4f12c05b9019d3ffed3285bb: start","job_status":"start","queue_duration_s":1.367673,"scheduling_latency_s":1.367694} gitlab # [ 236.855125] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"4f12c05b9019d3ffed3285bb","created_at":"2026-08-23T07:14:31.025Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19b98a3fb2ac0aac2eeaaf0099d83fc9","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.039Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-4f12c05b9019d3ffed3285bb: done: 0.030524 sec","job_status":"done","queue_duration_s":1.367673,"scheduling_latency_s":1.367694,"redis_calls":12,"redis_duration_s":0.003499,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000716,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001568,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001215,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016133,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00056402,"exclusive_lock_hold_duration_s":0.00978426,"duration_s":0.030524,"completed_at":"2026-08-23T07:14:32.437Z","load_balancing_strategy":"primary","db_duration_s":0.005771,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 236.896534] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.439Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"ab6bde936b631c0c42fc6317","created_at":"2026-08-23T07:14:31.055Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ea44a484dd9c54a4aed449c85da430d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.080Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-ab6bde936b631c0c42fc6317: start","job_status":"start","queue_duration_s":1.358033,"scheduling_latency_s":1.358051} gitlab # [ 236.910576] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"ab6bde936b631c0c42fc6317","created_at":"2026-08-23T07:14:31.055Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ea44a484dd9c54a4aed449c85da430d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.080Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-ab6bde936b631c0c42fc6317: done: 0.203997 sec","job_status":"done","queue_duration_s":1.358033,"scheduling_latency_s":1.358051,"redis_calls":12,"redis_duration_s":0.003539,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000506,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001352,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.170585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055224,"exclusive_lock_hold_duration_s":0.18267619999999998,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.203997,"completed_at":"2026-08-23T07:14:32.642Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027732,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null} gitlab # [ 236.955435] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.644Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"758d050d931ae07311e846dc","created_at":"2026-08-23T07:14:31.086Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff8315b4a15ec34cc352dbea7db05b0e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.146Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-758d050d931ae07311e846dc: start","job_status":"start","queue_duration_s":1.498295,"scheduling_latency_s":1.498313} gitlab # [ 236.969881] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.669Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"758d050d931ae07311e846dc","created_at":"2026-08-23T07:14:31.086Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff8315b4a15ec34cc352dbea7db05b0e","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.146Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-758d050d931ae07311e846dc: done: 0.025187 sec","job_status":"done","queue_duration_s":1.498295,"scheduling_latency_s":1.498313,"redis_calls":12,"redis_duration_s":0.003023,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000536,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001378,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001109,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00060274,"exclusive_lock_hold_duration_s":0.00455066,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.025187,"completed_at":"2026-08-23T07:14:32.669Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002882,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.014890] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.671Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"3ef0321374878066ab1205ce","created_at":"2026-08-23T07:14:31.163Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d3da1e211f536d0bdf915c197062059","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.182Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-3ef0321374878066ab1205ce: start","job_status":"start","queue_duration_s":1.489206,"scheduling_latency_s":1.489224} gitlab # [ 237.029648] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.702Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"3ef0321374878066ab1205ce","created_at":"2026-08-23T07:14:31.163Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1d3da1e211f536d0bdf915c197062059","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.182Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-3ef0321374878066ab1205ce: done: 0.030883 sec","job_status":"done","queue_duration_s":1.489206,"scheduling_latency_s":1.489224,"redis_calls":10,"redis_duration_s":0.002757,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000497,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001641,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000619,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017547,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004686,"duration_s":0.030883,"completed_at":"2026-08-23T07:14:32.702Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005479,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.071584] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.703Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"b3dd43cf3fc7727db320c244","created_at":"2026-08-23T07:14:31.189Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"96a4f276da32f9c01f49d44fa4710054","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.203Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-b3dd43cf3fc7727db320c244: start","job_status":"start","queue_duration_s":1.500327,"scheduling_latency_s":1.500344} gitlab # [ 237.086167] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.717Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 237.089572] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.724Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"b3dd43cf3fc7727db320c244","created_at":"2026-08-23T07:14:31.189Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"96a4f276da32f9c01f49d44fa4710054","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.203Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-b3dd43cf3fc7727db320c244: done: 0.020799 sec","job_status":"done","queue_duration_s":1.500327,"scheduling_latency_s":1.500344,"redis_calls":10,"redis_duration_s":0.002519,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000564,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033592,"duration_s":0.020799,"completed_at":"2026-08-23T07:14:32.724Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000684,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.132306] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.726Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a781be3f71587d3592edd1ae","created_at":"2026-08-23T07:14:31.214Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"355fd144d122a3423bf3cb837c020dfe","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.226Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a781be3f71587d3592edd1ae: start","job_status":"start","queue_duration_s":1.499473,"scheduling_latency_s":1.49949} gitlab # [ 237.146518] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.752Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a781be3f71587d3592edd1ae","created_at":"2026-08-23T07:14:31.214Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"355fd144d122a3423bf3cb837c020dfe","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.226Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a781be3f71587d3592edd1ae: done: 0.025939 sec","job_status":"done","queue_duration_s":1.499473,"scheduling_latency_s":1.49949,"redis_calls":10,"redis_duration_s":0.002554,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000527,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001531,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032568,"duration_s":0.025939,"completed_at":"2026-08-23T07:14:32.752Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004044,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.188720] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.754Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d337c6ae6a1f7c747affb237","created_at":"2026-08-23T07:14:31.232Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0958fe13d059ff2691b8088ff40b9175","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.241Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d337c6ae6a1f7c747affb237: start","job_status":"start","queue_duration_s":1.512452,"scheduling_latency_s":1.51247} gitlab # [ 237.202643] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.802Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d337c6ae6a1f7c747affb237","created_at":"2026-08-23T07:14:31.232Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0958fe13d059ff2691b8088ff40b9175","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.241Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d337c6ae6a1f7c747affb237: done: 0.048566 sec","job_status":"done","queue_duration_s":1.512452,"scheduling_latency_s":1.51247,"redis_calls":16,"redis_duration_s":0.004298,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002698,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001162,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000438,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029772,"duration_s":0.048566,"completed_at":"2026-08-23T07:14:32.802Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0181,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.245957] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:32.803Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"306e0fccb2efc92938fd889a","created_at":"2026-08-23T07:14:31.254Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53f0636eefbe2299c1b871ebbb067858","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.289Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-306e0fccb2efc92938fd889a: start","job_status":"start","queue_duration_s":1.514016,"scheduling_latency_s":1.514034} gitlab # [ 237.260240] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.044Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"306e0fccb2efc92938fd889a","created_at":"2026-08-23T07:14:31.254Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53f0636eefbe2299c1b871ebbb067858","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.289Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-306e0fccb2efc92938fd889a: done: 0.240829 sec","job_status":"done","queue_duration_s":1.514016,"scheduling_latency_s":1.514034,"redis_calls":14,"redis_duration_s":0.002075,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000599,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00079,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000686,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.033,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.202322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00046642,"exclusive_lock_hold_duration_s":0.21374668,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.240829,"completed_at":"2026-08-23T07:14:33.044Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045217,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.304890] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.045Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"5577594d7d30aababee9e7f2","created_at":"2026-08-23T07:14:31.330Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f54d8e0661dc8abc7a7312d8b4e327c9","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.350Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-5577594d7d30aababee9e7f2: start","job_status":"start","queue_duration_s":1.695387,"scheduling_latency_s":1.695406} gitlab # [ 237.318256] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.066Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"5577594d7d30aababee9e7f2","created_at":"2026-08-23T07:14:31.330Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f54d8e0661dc8abc7a7312d8b4e327c9","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.350Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-5577594d7d30aababee9e7f2: done: 0.020432 sec","job_status":"done","queue_duration_s":1.695387,"scheduling_latency_s":1.695406,"redis_calls":12,"redis_duration_s":0.00168,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000373,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000295,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012235,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023778,"duration_s":0.020432,"completed_at":"2026-08-23T07:14:33.066Z","load_balancing_strategy":"primary","db_duration_s":0.000324,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.360788] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.067Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ea28857c7de0f201d0852acc","created_at":"2026-08-23T07:14:31.389Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90d29fa0bbc97541f89848e87e6b4435","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.414Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ea28857c7de0f201d0852acc: start","job_status":"start","queue_duration_s":1.653429,"scheduling_latency_s":1.653446} gitlab # [ 237.375221] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.124Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"ea28857c7de0f201d0852acc","created_at":"2026-08-23T07:14:31.389Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90d29fa0bbc97541f89848e87e6b4435","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.414Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-ea28857c7de0f201d0852acc: done: 0.056769 sec","job_status":"done","queue_duration_s":1.653429,"scheduling_latency_s":1.653446,"redis_calls":14,"redis_duration_s":0.001992,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00059,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000642,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00046276,"exclusive_lock_hold_duration_s":0.0345264,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.056769,"completed_at":"2026-08-23T07:14:33.124Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.421331] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c4a2fa19f55de763c94007c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c4a2fa19f55de763c94007c: start","job_status":"start","queue_duration_s":1.536825,"scheduling_latency_s":1.536843} gitlab # [ 237.433851] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.147Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c4a2fa19f55de763c94007c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c4a2fa19f55de763c94007c: done: 0.022065 sec","job_status":"done","queue_duration_s":1.536825,"scheduling_latency_s":1.536843,"redis_calls":16,"redis_duration_s":0.0023150000000000002,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001427,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000229,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022065,"completed_at":"2026-08-23T07:14:33.147Z","load_balancing_strategy":"primary","db_duration_s":0.000351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.475052] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92baca96151c72089ec472fa","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92baca96151c72089ec472fa: start","job_status":"start","queue_duration_s":1.560029,"scheduling_latency_s":1.560048} gitlab # [ 237.487745] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.164Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92baca96151c72089ec472fa","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92baca96151c72089ec472fa: done: 0.015474 sec","job_status":"done","queue_duration_s":1.560029,"scheduling_latency_s":1.560048,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015474,"completed_at":"2026-08-23T07:14:33.164Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.527843] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.165Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c4a60f7e54b03b8292f200c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c4a60f7e54b03b8292f200c: start","job_status":"start","queue_duration_s":1.576578,"scheduling_latency_s":1.576597} gitlab # [ 237.540503] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c4a60f7e54b03b8292f200c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c4a60f7e54b03b8292f200c: done: 0.015374 sec","job_status":"done","queue_duration_s":1.576578,"scheduling_latency_s":1.576597,"redis_calls":13,"redis_duration_s":0.00163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015374,"completed_at":"2026-08-23T07:14:33.180Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.579220] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"024174e2cecd97f15e643037","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-024174e2cecd97f15e643037: start","job_status":"start","queue_duration_s":1.593043,"scheduling_latency_s":1.59306} gitlab # [ 237.591790] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"024174e2cecd97f15e643037","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-024174e2cecd97f15e643037: done: 0.015308 sec","job_status":"done","queue_duration_s":1.593043,"scheduling_latency_s":1.59306,"redis_calls":13,"redis_duration_s":0.001487,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010468,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015308,"completed_at":"2026-08-23T07:14:33.197Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.631803] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65553b8d602d7cf6fd39401e","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65553b8d602d7cf6fd39401e: start","job_status":"start","queue_duration_s":1.609668,"scheduling_latency_s":1.609687} gitlab # [ 237.644475] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"65553b8d602d7cf6fd39401e","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-65553b8d602d7cf6fd39401e: done: 0.015092 sec","job_status":"done","queue_duration_s":1.609668,"scheduling_latency_s":1.609687,"redis_calls":13,"redis_duration_s":0.001478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015092,"completed_at":"2026-08-23T07:14:33.213Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.683329] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b565f125c9f00d5f1d2f1563","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b565f125c9f00d5f1d2f1563: start","job_status":"start","queue_duration_s":1.626002,"scheduling_latency_s":1.626021} gitlab # [ 237.695696] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b565f125c9f00d5f1d2f1563","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b565f125c9f00d5f1d2f1563: done: 0.015235 sec","job_status":"done","queue_duration_s":1.626002,"scheduling_latency_s":1.626021,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010357,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015235,"completed_at":"2026-08-23T07:14:33.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.734939] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e040fee016004c4b32241cbc","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e040fee016004c4b32241cbc: start","job_status":"start","queue_duration_s":1.642466,"scheduling_latency_s":1.642483} gitlab # [ 237.747238] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e040fee016004c4b32241cbc","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e040fee016004c4b32241cbc: done: 0.015192 sec","job_status":"done","queue_duration_s":1.642466,"scheduling_latency_s":1.642483,"redis_calls":13,"redis_duration_s":0.0015660000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000589,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015192,"completed_at":"2026-08-23T07:14:33.246Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.786701] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8a3d2fb3bdd29efc4c00509","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8a3d2fb3bdd29efc4c00509: start","job_status":"start","queue_duration_s":1.658915,"scheduling_latency_s":1.658933} gitlab # [ 237.799109] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8a3d2fb3bdd29efc4c00509","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8a3d2fb3bdd29efc4c00509: done: 0.015023 sec","job_status":"done","queue_duration_s":1.658915,"scheduling_latency_s":1.658933,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015023,"completed_at":"2026-08-23T07:14:33.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.839061] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0526d24f6b1943c566178d4d","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0526d24f6b1943c566178d4d: start","job_status":"start","queue_duration_s":1.675169,"scheduling_latency_s":1.675188} gitlab # [ 237.851589] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0526d24f6b1943c566178d4d","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0526d24f6b1943c566178d4d: done: 0.015155 sec","job_status":"done","queue_duration_s":1.675169,"scheduling_latency_s":1.675188,"redis_calls":13,"redis_duration_s":0.001465,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015155,"completed_at":"2026-08-23T07:14:33.279Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.890663] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e55a9196ec53f0035ed6eed3","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e55a9196ec53f0035ed6eed3: start","job_status":"start","queue_duration_s":1.691592,"scheduling_latency_s":1.691609} gitlab # [ 237.903250] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e55a9196ec53f0035ed6eed3","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e55a9196ec53f0035ed6eed3: done: 0.015591 sec","job_status":"done","queue_duration_s":1.691592,"scheduling_latency_s":1.691609,"redis_calls":13,"redis_duration_s":0.0018739999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000579,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001295,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01071,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015591,"completed_at":"2026-08-23T07:14:33.295Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.942418] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.297Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b91b1669caed6830937b61df","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b91b1669caed6830937b61df: start","job_status":"start","queue_duration_s":1.708266,"scheduling_latency_s":1.708285} gitlab # [ 237.954999] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b91b1669caed6830937b61df","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b91b1669caed6830937b61df: done: 0.015444 sec","job_status":"done","queue_duration_s":1.708266,"scheduling_latency_s":1.708285,"redis_calls":13,"redis_duration_s":0.001674,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001127,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015444,"completed_at":"2026-08-23T07:14:33.312Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 237.994064] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"953e1ebf90b509dad3e5620f","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-953e1ebf90b509dad3e5620f: start","job_status":"start","queue_duration_s":1.724872,"scheduling_latency_s":1.72489} gitlab # [ 238.006614] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.328Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"953e1ebf90b509dad3e5620f","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-953e1ebf90b509dad3e5620f: done: 0.015333 sec","job_status":"done","queue_duration_s":1.724872,"scheduling_latency_s":1.72489,"redis_calls":13,"redis_duration_s":0.001679,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001124,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015333,"completed_at":"2026-08-23T07:14:33.328Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.046765] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcc23404f454f012b0ec5556","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcc23404f454f012b0ec5556: start","job_status":"start","queue_duration_s":1.741458,"scheduling_latency_s":1.741476} gitlab # [ 238.059541] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dcc23404f454f012b0ec5556","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dcc23404f454f012b0ec5556: done: 0.015424 sec","job_status":"done","queue_duration_s":1.741458,"scheduling_latency_s":1.741476,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015424,"completed_at":"2026-08-23T07:14:33.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.098391] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"224905a6c39cbac891c8fb0c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-224905a6c39cbac891c8fb0c: start","job_status":"start","queue_duration_s":1.758015,"scheduling_latency_s":1.758035} gitlab # [ 238.110850] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"224905a6c39cbac891c8fb0c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-224905a6c39cbac891c8fb0c: done: 0.01532 sec","job_status":"done","queue_duration_s":1.758015,"scheduling_latency_s":1.758035,"redis_calls":13,"redis_duration_s":0.00166,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01532,"completed_at":"2026-08-23T07:14:33.362Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.149636] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5eecc30b3212e70731e6ea9e","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5eecc30b3212e70731e6ea9e: start","job_status":"start","queue_duration_s":1.774625,"scheduling_latency_s":1.774644} gitlab # [ 238.161749] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5eecc30b3212e70731e6ea9e","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5eecc30b3212e70731e6ea9e: done: 0.015063 sec","job_status":"done","queue_duration_s":1.774625,"scheduling_latency_s":1.774644,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010315,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015063,"completed_at":"2026-08-23T07:14:33.378Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.200460] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd4c1cea82d667522cd9dbda","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd4c1cea82d667522cd9dbda: start","job_status":"start","queue_duration_s":1.79092,"scheduling_latency_s":1.790937} gitlab # [ 238.212558] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dd4c1cea82d667522cd9dbda","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dd4c1cea82d667522cd9dbda: done: 0.015461 sec","job_status":"done","queue_duration_s":1.79092,"scheduling_latency_s":1.790937,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010578,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015461,"completed_at":"2026-08-23T07:14:33.395Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.252330] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.396Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e953f1641a01bacd9875929b","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e953f1641a01bacd9875929b: start","job_status":"start","queue_duration_s":1.807636,"scheduling_latency_s":1.807655} gitlab # [ 238.264513] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e953f1641a01bacd9875929b","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e953f1641a01bacd9875929b: done: 0.015153 sec","job_status":"done","queue_duration_s":1.807636,"scheduling_latency_s":1.807655,"redis_calls":13,"redis_duration_s":0.001556,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015153,"completed_at":"2026-08-23T07:14:33.411Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.303374] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"888471e0003c861d32b865da","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-888471e0003c861d32b865da: start","job_status":"start","queue_duration_s":1.824027,"scheduling_latency_s":1.824046} gitlab # [ 238.315683] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"888471e0003c861d32b865da","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-888471e0003c861d32b865da: done: 0.014804 sec","job_status":"done","queue_duration_s":1.824027,"scheduling_latency_s":1.824046,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014804,"completed_at":"2026-08-23T07:14:33.427Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.354642] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.428Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38e5e671aac2dc5363e02af8","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38e5e671aac2dc5363e02af8: start","job_status":"start","queue_duration_s":1.840112,"scheduling_latency_s":1.840131} gitlab # [ 238.367227] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.444Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"38e5e671aac2dc5363e02af8","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-38e5e671aac2dc5363e02af8: done: 0.015249 sec","job_status":"done","queue_duration_s":1.840112,"scheduling_latency_s":1.840131,"redis_calls":13,"redis_duration_s":0.001689,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000745,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015249,"completed_at":"2026-08-23T07:14:33.444Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.406137] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"600b7659cd47b51f580564b7","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-600b7659cd47b51f580564b7: start","job_status":"start","queue_duration_s":1.856582,"scheduling_latency_s":1.856601} gitlab # [ 238.418231] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.460Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"600b7659cd47b51f580564b7","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-600b7659cd47b51f580564b7: done: 0.015051 sec","job_status":"done","queue_duration_s":1.856582,"scheduling_latency_s":1.856601,"redis_calls":13,"redis_duration_s":0.0014650000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010432,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015051,"completed_at":"2026-08-23T07:14:33.460Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.457985] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94b4c49026715ba483090e58","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94b4c49026715ba483090e58: start","job_status":"start","queue_duration_s":1.872715,"scheduling_latency_s":1.872734} gitlab # [ 238.470345] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94b4c49026715ba483090e58","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94b4c49026715ba483090e58: done: 0.015479 sec","job_status":"done","queue_duration_s":1.872715,"scheduling_latency_s":1.872734,"redis_calls":13,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0104,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015479,"completed_at":"2026-08-23T07:14:33.476Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.509033] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a777fbf30dbadd799f5d8d32","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a777fbf30dbadd799f5d8d32: start","job_status":"start","queue_duration_s":1.889302,"scheduling_latency_s":1.88932} gitlab # [ 238.521020] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a777fbf30dbadd799f5d8d32","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a777fbf30dbadd799f5d8d32: done: 0.015686 sec","job_status":"done","queue_duration_s":1.889302,"scheduling_latency_s":1.88932,"redis_calls":13,"redis_duration_s":0.0015010000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015686,"completed_at":"2026-08-23T07:14:33.493Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.559897] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c2304afbec4ff3a093c9876","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c2304afbec4ff3a093c9876: start","job_status":"start","queue_duration_s":1.906293,"scheduling_latency_s":1.906311} gitlab # [ 238.572368] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c2304afbec4ff3a093c9876","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c2304afbec4ff3a093c9876: done: 0.01517 sec","job_status":"done","queue_duration_s":1.906293,"scheduling_latency_s":1.906311,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01517,"completed_at":"2026-08-23T07:14:33.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.610889] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aeff9f4d4c760ae16dbff0a3","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aeff9f4d4c760ae16dbff0a3: start","job_status":"start","queue_duration_s":1.922571,"scheduling_latency_s":1.92259} gitlab # [ 238.623439] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aeff9f4d4c760ae16dbff0a3","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aeff9f4d4c760ae16dbff0a3: done: 0.014946 sec","job_status":"done","queue_duration_s":1.922571,"scheduling_latency_s":1.92259,"redis_calls":13,"redis_duration_s":0.0014910000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014946,"completed_at":"2026-08-23T07:14:33.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.663252] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf07714061c001ff6abdcf42","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf07714061c001ff6abdcf42: start","job_status":"start","queue_duration_s":1.938811,"scheduling_latency_s":1.93883} gitlab # [ 238.675542] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf07714061c001ff6abdcf42","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf07714061c001ff6abdcf42: done: 0.015265 sec","job_status":"done","queue_duration_s":1.938811,"scheduling_latency_s":1.93883,"redis_calls":13,"redis_duration_s":0.001501,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010453,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015265,"completed_at":"2026-08-23T07:14:33.542Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.714147] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"768e8fc900dc24a132de2a0b","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-768e8fc900dc24a132de2a0b: start","job_status":"start","queue_duration_s":1.955474,"scheduling_latency_s":1.955495} gitlab # [ 238.726482] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"768e8fc900dc24a132de2a0b","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-768e8fc900dc24a132de2a0b: done: 0.01512 sec","job_status":"done","queue_duration_s":1.955474,"scheduling_latency_s":1.955495,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01512,"completed_at":"2026-08-23T07:14:33.559Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.764998] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.560Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4dbef67f77c5e8c59b669b51","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4dbef67f77c5e8c59b669b51: start","job_status":"start","queue_duration_s":1.971682,"scheduling_latency_s":1.9717} gitlab # [ 238.777074] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4dbef67f77c5e8c59b669b51","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4dbef67f77c5e8c59b669b51: done: 0.015271 sec","job_status":"done","queue_duration_s":1.971682,"scheduling_latency_s":1.9717,"redis_calls":13,"redis_duration_s":0.001607,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001064,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010719,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015271,"completed_at":"2026-08-23T07:14:33.575Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.816199] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75eefec61587e1cce53a427a","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75eefec61587e1cce53a427a: start","job_status":"start","queue_duration_s":1.988319,"scheduling_latency_s":1.988339} gitlab # [ 238.828532] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.591Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"75eefec61587e1cce53a427a","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-75eefec61587e1cce53a427a: done: 0.014901 sec","job_status":"done","queue_duration_s":1.988319,"scheduling_latency_s":1.988339,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014901,"completed_at":"2026-08-23T07:14:33.591Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.868947] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"860f5c6f5603063aa94eadd7","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-860f5c6f5603063aa94eadd7: start","job_status":"start","queue_duration_s":2.00471,"scheduling_latency_s":2.004729} gitlab # [ 238.881436] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"860f5c6f5603063aa94eadd7","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-860f5c6f5603063aa94eadd7: done: 0.015193 sec","job_status":"done","queue_duration_s":2.00471,"scheduling_latency_s":2.004729,"redis_calls":13,"redis_duration_s":0.001453,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015193,"completed_at":"2026-08-23T07:14:33.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.921354] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.609Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30130fc02fdd440478c034d8","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30130fc02fdd440478c034d8: start","job_status":"start","queue_duration_s":2.021015,"scheduling_latency_s":2.021033} gitlab # [ 238.934027] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30130fc02fdd440478c034d8","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30130fc02fdd440478c034d8: done: 0.015377 sec","job_status":"done","queue_duration_s":2.021015,"scheduling_latency_s":2.021033,"redis_calls":13,"redis_duration_s":0.0015,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000533,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000967,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010688,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015377,"completed_at":"2026-08-23T07:14:33.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 238.973472] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fa1f0211a5fb9c75486e6a4","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fa1f0211a5fb9c75486e6a4: start","job_status":"start","queue_duration_s":2.037495,"scheduling_latency_s":2.037513} gitlab # [ 238.986165] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.641Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8fa1f0211a5fb9c75486e6a4","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8fa1f0211a5fb9c75486e6a4: done: 0.015135 sec","job_status":"done","queue_duration_s":2.037495,"scheduling_latency_s":2.037513,"redis_calls":13,"redis_duration_s":0.001617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015135,"completed_at":"2026-08-23T07:14:33.641Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.025734] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97d8932c94bf864b8e8060d0","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97d8932c94bf864b8e8060d0: start","job_status":"start","queue_duration_s":2.053689,"scheduling_latency_s":2.053708} gitlab # [ 239.038144] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"97d8932c94bf864b8e8060d0","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-97d8932c94bf864b8e8060d0: done: 0.015487 sec","job_status":"done","queue_duration_s":2.053689,"scheduling_latency_s":2.053708,"redis_calls":13,"redis_duration_s":0.001491,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015487,"completed_at":"2026-08-23T07:14:33.657Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.079269] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31115574eec80df9dee11411","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31115574eec80df9dee11411: start","job_status":"start","queue_duration_s":2.07024,"scheduling_latency_s":2.070259} gitlab # [ 239.092098] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31115574eec80df9dee11411","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31115574eec80df9dee11411: done: 0.015561 sec","job_status":"done","queue_duration_s":2.07024,"scheduling_latency_s":2.070259,"redis_calls":13,"redis_duration_s":0.0015530000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010573,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015561,"completed_at":"2026-08-23T07:14:33.674Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.131766] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c91148e054875ca72b10dadf","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c91148e054875ca72b10dadf: start","job_status":"start","queue_duration_s":2.086944,"scheduling_latency_s":2.086961} gitlab # [ 239.144316] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c91148e054875ca72b10dadf","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c91148e054875ca72b10dadf: done: 0.014958 sec","job_status":"done","queue_duration_s":2.086944,"scheduling_latency_s":2.086961,"redis_calls":13,"redis_duration_s":0.0014620000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010262,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014958,"completed_at":"2026-08-23T07:14:33.690Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.183237] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.691Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61997b7cf964346ed293775c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61997b7cf964346ed293775c: start","job_status":"start","queue_duration_s":2.103182,"scheduling_latency_s":2.103201} gitlab # [ 239.196110] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61997b7cf964346ed293775c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61997b7cf964346ed293775c: done: 0.015341 sec","job_status":"done","queue_duration_s":2.103182,"scheduling_latency_s":2.103201,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015341,"completed_at":"2026-08-23T07:14:33.707Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.235248] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ecddb0ee21ef73b500a906c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ecddb0ee21ef73b500a906c: start","job_status":"start","queue_duration_s":2.119895,"scheduling_latency_s":2.119913} gitlab # [ 239.247942] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ecddb0ee21ef73b500a906c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ecddb0ee21ef73b500a906c: done: 0.015689 sec","job_status":"done","queue_duration_s":2.119895,"scheduling_latency_s":2.119913,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015689,"completed_at":"2026-08-23T07:14:33.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.288171] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"131d9c3ae5c96b2ac04f491c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-131d9c3ae5c96b2ac04f491c: start","job_status":"start","queue_duration_s":2.137139,"scheduling_latency_s":2.137158} gitlab # [ 239.300348] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"131d9c3ae5c96b2ac04f491c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-131d9c3ae5c96b2ac04f491c: done: 0.015017 sec","job_status":"done","queue_duration_s":2.137139,"scheduling_latency_s":2.137158,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015017,"completed_at":"2026-08-23T07:14:33.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.339721] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.742Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f424d73e6dbdd52d96676f7","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f424d73e6dbdd52d96676f7: start","job_status":"start","queue_duration_s":2.153405,"scheduling_latency_s":2.153422} gitlab # [ 239.352262] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.757Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f424d73e6dbdd52d96676f7","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f424d73e6dbdd52d96676f7: done: 0.015312 sec","job_status":"done","queue_duration_s":2.153405,"scheduling_latency_s":2.153422,"redis_calls":13,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000963,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015312,"completed_at":"2026-08-23T07:14:33.757Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.391446] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3aa7188a4d224d4d5af3413c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3aa7188a4d224d4d5af3413c: start","job_status":"start","queue_duration_s":2.170101,"scheduling_latency_s":2.170119} gitlab # [ 239.404154] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.773Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3aa7188a4d224d4d5af3413c","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3aa7188a4d224d4d5af3413c: done: 0.015143 sec","job_status":"done","queue_duration_s":2.170101,"scheduling_latency_s":2.170119,"redis_calls":13,"redis_duration_s":0.001473,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010461,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015143,"completed_at":"2026-08-23T07:14:33.773Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.443268] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.775Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7e89584abe95ce9a760b858","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7e89584abe95ce9a760b858: start","job_status":"start","queue_duration_s":2.186297,"scheduling_latency_s":2.186314} gitlab # [ 239.456619] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.790Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7e89584abe95ce9a760b858","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7e89584abe95ce9a760b858: done: 0.015096 sec","job_status":"done","queue_duration_s":2.186297,"scheduling_latency_s":2.186314,"redis_calls":13,"redis_duration_s":0.001616,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015096,"completed_at":"2026-08-23T07:14:33.790Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.495824] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ed101e4c55b3726b3324b0a","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ed101e4c55b3726b3324b0a: start","job_status":"start","queue_duration_s":2.202591,"scheduling_latency_s":2.20261} gitlab # [ 239.508502] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ed101e4c55b3726b3324b0a","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ed101e4c55b3726b3324b0a: done: 0.015868 sec","job_status":"done","queue_duration_s":2.202591,"scheduling_latency_s":2.20261,"redis_calls":13,"redis_duration_s":0.0016289999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001068,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015868,"completed_at":"2026-08-23T07:14:33.807Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.547565] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f931f0e6115a0d9fc250f98f","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f931f0e6115a0d9fc250f98f: start","job_status":"start","queue_duration_s":2.219507,"scheduling_latency_s":2.219525} gitlab # [ 239.560257] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f931f0e6115a0d9fc250f98f","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f931f0e6115a0d9fc250f98f: done: 0.015266 sec","job_status":"done","queue_duration_s":2.219507,"scheduling_latency_s":2.219525,"redis_calls":13,"redis_duration_s":0.001827,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000742,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015266,"completed_at":"2026-08-23T07:14:33.823Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.599362] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbc3cb811f7313aa50d65d40","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbc3cb811f7313aa50d65d40: start","job_status":"start","queue_duration_s":2.235843,"scheduling_latency_s":2.235862} gitlab # [ 239.611755] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dbc3cb811f7313aa50d65d40","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dbc3cb811f7313aa50d65d40: done: 0.015171 sec","job_status":"done","queue_duration_s":2.235843,"scheduling_latency_s":2.235862,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000575,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015171,"completed_at":"2026-08-23T07:14:33.839Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.651224] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11c7aa53ed3c53d3e9d3a217","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11c7aa53ed3c53d3e9d3a217: start","job_status":"start","queue_duration_s":2.252125,"scheduling_latency_s":2.252144} gitlab # [ 239.664534] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"11c7aa53ed3c53d3e9d3a217","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-11c7aa53ed3c53d3e9d3a217: done: 0.015313 sec","job_status":"done","queue_duration_s":2.252125,"scheduling_latency_s":2.252144,"redis_calls":13,"redis_duration_s":0.0015309999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000553,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010575,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015313,"completed_at":"2026-08-23T07:14:33.856Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.704452] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a1e3da5626deb381b9c7134","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a1e3da5626deb381b9c7134: start","job_status":"start","queue_duration_s":2.268802,"scheduling_latency_s":2.268821} gitlab # [ 239.716853] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a1e3da5626deb381b9c7134","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a1e3da5626deb381b9c7134: done: 0.016561 sec","job_status":"done","queue_duration_s":2.268802,"scheduling_latency_s":2.268821,"redis_calls":13,"redis_duration_s":0.001807,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000635,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016561,"completed_at":"2026-08-23T07:14:33.874Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.756650] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b9465725a7043244f8ef7ff","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b9465725a7043244f8ef7ff: start","job_status":"start","queue_duration_s":2.286677,"scheduling_latency_s":2.286694} gitlab # [ 239.768928] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.891Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b9465725a7043244f8ef7ff","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b9465725a7043244f8ef7ff: done: 0.015653 sec","job_status":"done","queue_duration_s":2.286677,"scheduling_latency_s":2.286694,"redis_calls":13,"redis_duration_s":0.0015170000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015653,"completed_at":"2026-08-23T07:14:33.891Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.808885] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77007281da05e712e4072b25","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77007281da05e712e4072b25: start","job_status":"start","queue_duration_s":2.303636,"scheduling_latency_s":2.303656} gitlab # [ 239.822071] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77007281da05e712e4072b25","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77007281da05e712e4072b25: done: 0.015884 sec","job_status":"done","queue_duration_s":2.303636,"scheduling_latency_s":2.303656,"redis_calls":13,"redis_duration_s":0.00158,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001038,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015884,"completed_at":"2026-08-23T07:14:33.908Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.862030] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4acb96ba37318c934c0be0b1","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4acb96ba37318c934c0be0b1: start","job_status":"start","queue_duration_s":2.320815,"scheduling_latency_s":2.320834} gitlab # [ 239.874892] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4acb96ba37318c934c0be0b1","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4acb96ba37318c934c0be0b1: done: 0.014892 sec","job_status":"done","queue_duration_s":2.320815,"scheduling_latency_s":2.320834,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014892,"completed_at":"2026-08-23T07:14:33.924Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.913493] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3badcac2b73afbf9daa6a15","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3badcac2b73afbf9daa6a15: start","job_status":"start","queue_duration_s":2.337192,"scheduling_latency_s":2.337212} gitlab # [ 239.925643] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3badcac2b73afbf9daa6a15","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3badcac2b73afbf9daa6a15: done: 0.015024 sec","job_status":"done","queue_duration_s":2.337192,"scheduling_latency_s":2.337212,"redis_calls":13,"redis_duration_s":0.001447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010491,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015024,"completed_at":"2026-08-23T07:14:33.940Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 239.964294] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7411100627dd87bc3dd90b2","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7411100627dd87bc3dd90b2: start","job_status":"start","queue_duration_s":2.353363,"scheduling_latency_s":2.35338} gitlab # [ 239.976424] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7411100627dd87bc3dd90b2","created_at":"2026-08-23T07:14:31.352Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-62dd071096fb4f6f","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7b97f27ab1dd251bad414a76ff15854f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:31.588Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7411100627dd87bc3dd90b2: done: 0.0153 sec","job_status":"done","queue_duration_s":2.353363,"scheduling_latency_s":2.35338,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000962,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0153,"completed_at":"2026-08-23T07:14:33.957Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.014790] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.958Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1f1fb43ca9711c1d5baf5dc2","created_at":"2026-08-23T07:14:32.383Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-3afd53c1c95a4c1b","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6af102931981b4eed10fc9904a7ace92","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:32.397Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1f1fb43ca9711c1d5baf5dc2: start","job_status":"start","queue_duration_s":1.561128,"scheduling_latency_s":1.561145} gitlab # [ 240.027638] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.975Z","message":"No existing merge request to be cleaned up."} gitlab # [ 240.029442] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.989Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1f1fb43ca9711c1d5baf5dc2","created_at":"2026-08-23T07:14:32.383Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-3afd53c1c95a4c1b","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6af102931981b4eed10fc9904a7ace92","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:32.397Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1f1fb43ca9711c1d5baf5dc2: done: 0.031435 sec","job_status":"done","queue_duration_s":1.561128,"scheduling_latency_s":1.561145,"redis_calls":13,"redis_duration_s":0.0019850000000000002,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000287,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000858,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025836,"duration_s":0.031435,"completed_at":"2026-08-23T07:14:33.989Z","load_balancing_strategy":"primary","db_duration_s":0.003788,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.070534] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:33.991Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d02f59849fb917568b8cd220","created_at":"2026-08-23T07:14:32.383Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-3afd53c1c95a4c1b","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6af102931981b4eed10fc9904a7ace92","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:32.397Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d02f59849fb917568b8cd220: start","job_status":"start","queue_duration_s":1.593834,"scheduling_latency_s":1.593852} gitlab # [ 240.083035] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:34.002Z","message":"No existing merge request to be cleaned up."} gitlab # [ 240.084709] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:34.010Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d02f59849fb917568b8cd220","created_at":"2026-08-23T07:14:32.383Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-3afd53c1c95a4c1b","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6af102931981b4eed10fc9904a7ace92","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:32.397Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d02f59849fb917568b8cd220: done: 0.019729 sec","job_status":"done","queue_duration_s":1.593834,"scheduling_latency_s":1.593852,"redis_calls":10,"redis_duration_s":0.001365,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000577,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000788,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019729,"completed_at":"2026-08-23T07:14:34.010Z","load_balancing_strategy":"primary","db_duration_s":0.001583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.123376] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:34.012Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a61ab2fe5c5c88cb31b869d1","created_at":"2026-08-23T07:14:32.383Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-3afd53c1c95a4c1b","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6af102931981b4eed10fc9904a7ace92","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:32.397Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a61ab2fe5c5c88cb31b869d1: start","job_status":"start","queue_duration_s":1.614817,"scheduling_latency_s":1.614835} gitlab # [ 240.136057] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:34.022Z","message":"No existing merge request to be cleaned up."} gitlab # [ 240.137701] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:34.031Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a61ab2fe5c5c88cb31b869d1","created_at":"2026-08-23T07:14:32.383Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-3afd53c1c95a4c1b","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6af102931981b4eed10fc9904a7ace92","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:32.397Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a61ab2fe5c5c88cb31b869d1: done: 0.019118 sec","job_status":"done","queue_duration_s":1.614817,"scheduling_latency_s":1.614835,"redis_calls":10,"redis_duration_s":0.001364,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000597,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000767,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013867,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019118,"completed_at":"2026-08-23T07:14:34.031Z","load_balancing_strategy":"primary","db_duration_s":0.001274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 240.176301] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:34.032Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"50631aa540268d79c1978d27","created_at":"2026-08-23T07:14:32.383Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-3afd53c1c95a4c1b","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6af102931981b4eed10fc9904a7ace92","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:32.397Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-50631aa540268d79c1978d27: start","job_status":"start","queue_duration_s":1.635047,"scheduling_latency_s":1.635065} gitlab # [ 240.188987] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:34.043Z","message":"No existing merge request to be cleaned up."} gitlab # [ 240.190648] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:14:34.051Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"50631aa540268d79c1978d27","created_at":"2026-08-23T07:14:32.383Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-3afd53c1c95a4c1b","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"6af102931981b4eed10fc9904a7ace92","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:14:32.397Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-50631aa540268d79c1978d27: done: 0.019133 sec","job_status":"done","queue_duration_s":1.635047,"scheduling_latency_s":1.635065,"redis_calls":10,"redis_duration_s":0.001376,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000601,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019133,"completed_at":"2026-08-23T07:14:34.051Z","load_balancing_strategy":"primary","db_duration_s":0.001324,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.448196] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:02.303Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c7ce0079951feb5b9d023f5c","created_at":"2026-08-23T07:15:02.285Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f7009a309b18c3338b1c95013b0198b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.299Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c7ce0079951feb5b9d023f5c: start","job_status":"start","queue_duration_s":0.003685,"scheduling_latency_s":0.003747} gitlab # [ 266.597369] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:02.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"c7ce0079951feb5b9d023f5c","created_at":"2026-08-23T07:15:02.285Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0f7009a309b18c3338b1c95013b0198b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.299Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-c7ce0079951feb5b9d023f5c: done: 0.149989 sec","job_status":"done","queue_duration_s":0.003685,"scheduling_latency_s":0.003747,"redis_calls":10,"redis_duration_s":0.017015000000000002,"redis_read_bytes":135,"redis_write_bytes":1233,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.0041,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":64,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008026,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004889,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.06,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.06,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049475,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00332036,"exclusive_lock_hold_duration_s":0.0488282,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.149989,"completed_at":"2026-08-23T07:15:02.453Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.065949,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.681577] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:02.456Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bef5d910e3b05d727ab8bbbc","created_at":"2026-08-23T07:15:02.322Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3fb85d9f3861b3697b6140f93394673","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T07:15:02.338Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bef5d910e3b05d727ab8bbbc: start","job_status":"start","queue_duration_s":0.118206,"scheduling_latency_s":0.118251} gitlab # [ 266.696767] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:02.473Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 266.700620] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:02.523Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bef5d910e3b05d727ab8bbbc","created_at":"2026-08-23T07:15:02.322Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b3fb85d9f3861b3697b6140f93394673","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-23T07:15:02.338Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bef5d910e3b05d727ab8bbbc: done: 0.067176 sec","job_status":"done","queue_duration_s":0.118206,"scheduling_latency_s":0.118251,"redis_calls":7,"redis_duration_s":0.001593,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000498,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.067176,"completed_at":"2026-08-23T07:15:02.523Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 266.739758] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:02.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5b5453195218f31a001f9317","created_at":"2026-08-23T07:15:02.371Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.380Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5b5453195218f31a001f9317: start","job_status":"start","queue_duration_s":0.155919,"scheduling_latency_s":0.155941} gitlab # [ 266.949223] setup-gitlab-start[2929]: W, [2026-08-23T07:15:02.805125 #2929] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 267.090550] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:02.946Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"5b5453195218f31a001f9317","created_at":"2026-08-23T07:15:02.371Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.380Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-5b5453195218f31a001f9317: done: 0.410117 sec","job_status":"done","queue_duration_s":0.155919,"scheduling_latency_s":0.155941,"redis_calls":60,"redis_duration_s":0.090775,"redis_read_bytes":108,"redis_write_bytes":41009,"redis_queues_calls":2,"redis_queues_duration_s":0.001614,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37385,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.087693,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001468,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.194593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.410117,"completed_at":"2026-08-23T07:15:02.946Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.181362] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:02.956Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"8c119ec776f01053b28accb5","created_at":"2026-08-23T07:15:02.404Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b160eda8f9bbcbf064061101c05238c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.410Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-8c119ec776f01053b28accb5: start","job_status":"start","queue_duration_s":0.546407,"scheduling_latency_s":0.54646} gitlab # [ 267.700384] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.555Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"8c119ec776f01053b28accb5","created_at":"2026-08-23T07:15:02.404Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b160eda8f9bbcbf064061101c05238c","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.410Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-8c119ec776f01053b28accb5: done: 0.599302 sec","job_status":"done","queue_duration_s":0.546407,"scheduling_latency_s":0.54646,"redis_calls":562,"redis_duration_s":0.231577,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001506,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.230071,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.403989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.599302,"completed_at":"2026-08-23T07:15:03.555Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.793842] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"49cbc4c281cc0a0cebb2971e","created_at":"2026-08-23T07:15:02.426Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"680cfa21c870f870b41c904eddbe36a6","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.481Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-49cbc4c281cc0a0cebb2971e: start","job_status":"start","queue_duration_s":1.076202,"scheduling_latency_s":1.07623} gitlab # [ 267.811067] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.593Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainVerificationCronWorker","jid":"49cbc4c281cc0a0cebb2971e","created_at":"2026-08-23T07:15:02.426Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"680cfa21c870f870b41c904eddbe36a6","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:4b3095972298b58b9c376f502255d63e0934f66e5921dfe9547414a5f347be92","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.481Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainVerificationCronWorker JID-49cbc4c281cc0a0cebb2971e: done: 0.036144 sec","job_status":"done","queue_duration_s":1.076202,"scheduling_latency_s":1.07623,"redis_calls":10,"redis_duration_s":0.0029189999999999997,"redis_read_bytes":9,"redis_write_bytes":1097,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000527,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":309,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":218,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020534,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00083002,"duration_s":0.036144,"completed_at":"2026-08-23T07:15:03.593Z","load_balancing_strategy":"primary","db_duration_s":0.007754,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.857632] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.595Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c62f529342d7f3720c4509fc","created_at":"2026-08-23T07:15:02.513Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be66db18a25c15f1bf6063f46d3823cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T07:15:02.515Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c62f529342d7f3720c4509fc: start","job_status":"start","queue_duration_s":1.079549,"scheduling_latency_s":1.079568} gitlab # [ 267.872419] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.603Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 267.876004] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.609Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"c62f529342d7f3720c4509fc","created_at":"2026-08-23T07:15:02.513Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be66db18a25c15f1bf6063f46d3823cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-23T07:15:02.515Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-c62f529342d7f3720c4509fc: done: 0.013994 sec","job_status":"done","queue_duration_s":1.079549,"scheduling_latency_s":1.079568,"redis_calls":7,"redis_duration_s":0.001726,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001235,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008327,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013994,"completed_at":"2026-08-23T07:15:03.609Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.916402] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.610Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f60856fc24e2f2d636c8e2a3","created_at":"2026-08-23T07:15:02.520Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc536a3614b61f71c2f4d782eee6bb3d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.527Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f60856fc24e2f2d636c8e2a3: start","job_status":"start","queue_duration_s":1.083286,"scheduling_latency_s":1.083303} gitlab # [ 267.930831] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.618Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 267.934533] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.623Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"f60856fc24e2f2d636c8e2a3","created_at":"2026-08-23T07:15:02.520Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc536a3614b61f71c2f4d782eee6bb3d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.527Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-f60856fc24e2f2d636c8e2a3: done: 0.013307 sec","job_status":"done","queue_duration_s":1.083286,"scheduling_latency_s":1.083303,"redis_calls":7,"redis_duration_s":0.0016589999999999999,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00046,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013307,"completed_at":"2026-08-23T07:15:03.623Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 267.975193] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f2b6a30c82c4bb0edf42e023","created_at":"2026-08-23T07:15:02.534Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12e5e390042a299bede485f8c22f1d3a","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.547Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f2b6a30c82c4bb0edf42e023: start","job_status":"start","queue_duration_s":1.077671,"scheduling_latency_s":1.077689} gitlab # [ 267.990031] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.649Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"f2b6a30c82c4bb0edf42e023","created_at":"2026-08-23T07:15:02.534Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12e5e390042a299bede485f8c22f1d3a","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.547Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-f2b6a30c82c4bb0edf42e023: done: 0.024124 sec","job_status":"done","queue_duration_s":1.077671,"scheduling_latency_s":1.077689,"redis_calls":10,"redis_duration_s":0.002853,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001616,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001237,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014228,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00716424,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.024124,"completed_at":"2026-08-23T07:15:03.649Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00426,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 268.033637] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.651Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"13fe2ef8a0f9793641628aaa","created_at":"2026-08-23T07:15:02.556Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"77ddd62d3d62915d7c0eada020af467b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T07:15:02.564Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-13fe2ef8a0f9793641628aaa: start","job_status":"start","queue_duration_s":1.086162,"scheduling_latency_s":1.086179} gitlab # [ 268.046736] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.674Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"13fe2ef8a0f9793641628aaa","created_at":"2026-08-23T07:15:02.556Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"77ddd62d3d62915d7c0eada020af467b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-23T07:15:02.564Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-13fe2ef8a0f9793641628aaa: done: 0.023554 sec","job_status":"done","queue_duration_s":1.086162,"scheduling_latency_s":1.086179,"redis_calls":8,"redis_duration_s":0.002042,"redis_read_bytes":133,"redis_write_bytes":811,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000221,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001339,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000482,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015299,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023554,"completed_at":"2026-08-23T07:15:03.674Z","load_balancing_strategy":"primary","db_duration_s":0.002887,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.087816] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.676Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7310f0232e478355dfd56579","created_at":"2026-08-23T07:15:02.569Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a0d3e3d6f1b524225c1e67af633ec1af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.573Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7310f0232e478355dfd56579: start","job_status":"start","queue_duration_s":1.102057,"scheduling_latency_s":1.102075} gitlab # [ 268.102477] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.683Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 268.105744] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"7310f0232e478355dfd56579","created_at":"2026-08-23T07:15:02.569Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a0d3e3d6f1b524225c1e67af633ec1af","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.573Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-7310f0232e478355dfd56579: done: 0.013419 sec","job_status":"done","queue_duration_s":1.102057,"scheduling_latency_s":1.102075,"redis_calls":7,"redis_duration_s":0.001769,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001276,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000493,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013419,"completed_at":"2026-08-23T07:15:03.689Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.146195] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.690Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::StuckProjectImportJobsWorker","jid":"3866dda407ea16b0a075fc8b","created_at":"2026-08-23T07:15:02.577Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c14c2724767928c88500641605fe884","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:65d1a1bda9b2a0115065de4f20868193e50a174305a7166fa20fbc82759e43e4","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.587Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::StuckProjectImportJobsWorker JID-3866dda407ea16b0a075fc8b: start","job_status":"start","queue_duration_s":1.103423,"scheduling_latency_s":1.10344} gitlab # [ 268.159863] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Gitlab::Import::StuckProjectImportJobsWorker","jid":"3866dda407ea16b0a075fc8b","created_at":"2026-08-23T07:15:02.577Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3c14c2724767928c88500641605fe884","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:65d1a1bda9b2a0115065de4f20868193e50a174305a7166fa20fbc82759e43e4","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.587Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Gitlab::Import::StuckProjectImportJobsWorker JID-3866dda407ea16b0a075fc8b: done: 0.030018 sec","job_status":"done","queue_duration_s":1.103423,"scheduling_latency_s":1.10344,"redis_calls":10,"redis_duration_s":0.002649,"redis_read_bytes":9,"redis_write_bytes":1173,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00051,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001596,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000543,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":236,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045246,"duration_s":0.030018,"completed_at":"2026-08-23T07:15:03.720Z","load_balancing_strategy":"primary","db_duration_s":0.0064,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.201457] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.722Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMigrateExternalDiffsWorker","jid":"e41ba7b748336c60b2780a8f","created_at":"2026-08-23T07:15:02.589Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"719c09da054e3ba8be3d239dee50d035","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1f56d9ee4ddd7fd390ae51dd41358b9c806acf2491cad4e28b1956ebf69a9b52","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.599Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMigrateExternalDiffsWorker JID-e41ba7b748336c60b2780a8f: start","job_status":"start","queue_duration_s":1.122743,"scheduling_latency_s":1.122759} gitlab # [ 268.214926] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.741Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMigrateExternalDiffsWorker","jid":"e41ba7b748336c60b2780a8f","created_at":"2026-08-23T07:15:02.589Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"719c09da054e3ba8be3d239dee50d035","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1f56d9ee4ddd7fd390ae51dd41358b9c806acf2491cad4e28b1956ebf69a9b52","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.599Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMigrateExternalDiffsWorker JID-e41ba7b748336c60b2780a8f: done: 0.019275 sec","job_status":"done","queue_duration_s":1.122743,"scheduling_latency_s":1.122759,"redis_calls":12,"redis_duration_s":0.00297,"redis_read_bytes":11,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000531,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":311,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001384,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001055,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":533,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000579,"exclusive_lock_hold_duration_s":0.00047408,"duration_s":0.019275,"completed_at":"2026-08-23T07:15:03.741Z","load_balancing_strategy":"primary","db_duration_s":0.000656,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.257403] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.743Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a9c54dc6a33d7c7dac737d41","created_at":"2026-08-23T07:15:02.610Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4d8383417906a53ab2cd2a6817c3f00","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.615Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a9c54dc6a33d7c7dac737d41: start","job_status":"start","queue_duration_s":1.127651,"scheduling_latency_s":1.127668} gitlab # [ 268.271322] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.777Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"a9c54dc6a33d7c7dac737d41","created_at":"2026-08-23T07:15:02.610Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d4d8383417906a53ab2cd2a6817c3f00","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.615Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-a9c54dc6a33d7c7dac737d41: done: 0.033977 sec","job_status":"done","queue_duration_s":1.127651,"scheduling_latency_s":1.127668,"redis_calls":7,"redis_duration_s":0.001839,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001336,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000503,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.033977,"completed_at":"2026-08-23T07:15:03.777Z","load_balancing_strategy":"primary","db_duration_s":0.01915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.312498] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.778Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"e15307375670a2c3c22a7460","created_at":"2026-08-23T07:15:02.622Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b4c9a2d0526a11ab991fff2f6f0be05","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.636Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-e15307375670a2c3c22a7460: start","job_status":"start","queue_duration_s":1.142543,"scheduling_latency_s":1.142561} gitlab # [ 268.325933] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.810Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"e15307375670a2c3c22a7460","created_at":"2026-08-23T07:15:02.622Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0b4c9a2d0526a11ab991fff2f6f0be05","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.636Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-e15307375670a2c3c22a7460: done: 0.031607 sec","job_status":"done","queue_duration_s":1.142543,"scheduling_latency_s":1.142561,"redis_calls":10,"redis_duration_s":0.00311,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000973,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001558,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000579,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038854,"duration_s":0.031607,"completed_at":"2026-08-23T07:15:03.810Z","load_balancing_strategy":"primary","db_duration_s":0.006665,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.367152] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.811Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1aae6826b72b1d98f61a45f3","created_at":"2026-08-23T07:15:02.657Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30744bfd80c185118b9b94f643d4a373","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.664Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1aae6826b72b1d98f61a45f3: start","job_status":"start","queue_duration_s":1.147881,"scheduling_latency_s":1.147899} gitlab # [ 268.381955] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.820Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 268.386459] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.825Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1aae6826b72b1d98f61a45f3","created_at":"2026-08-23T07:15:02.657Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"30744bfd80c185118b9b94f643d4a373","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.664Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1aae6826b72b1d98f61a45f3: done: 0.013429 sec","job_status":"done","queue_duration_s":1.147881,"scheduling_latency_s":1.147899,"redis_calls":7,"redis_duration_s":0.001731,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001218,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000513,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013429,"completed_at":"2026-08-23T07:15:03.825Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.427107] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.826Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"cdaa34c48fc51d07822fa784","created_at":"2026-08-23T07:15:02.683Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c39ea6906292b5405825320dbfeaeb9c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.700Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-cdaa34c48fc51d07822fa784: start","job_status":"start","queue_duration_s":1.126619,"scheduling_latency_s":1.126637} gitlab # [ 268.442111] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.846Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"cdaa34c48fc51d07822fa784","created_at":"2026-08-23T07:15:02.683Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c39ea6906292b5405825320dbfeaeb9c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.700Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-cdaa34c48fc51d07822fa784: done: 0.020208 sec","job_status":"done","queue_duration_s":1.126619,"scheduling_latency_s":1.126637,"redis_calls":11,"redis_duration_s":0.002669,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001373,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000317,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031872,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.020208,"completed_at":"2026-08-23T07:15:03.846Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000648,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.485530] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.848Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a0399a5a520bf349e9f5e5d1","created_at":"2026-08-23T07:15:02.718Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aebd8632a32b7873e706c35c9c7785f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.726Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a0399a5a520bf349e9f5e5d1: start","job_status":"start","queue_duration_s":1.121871,"scheduling_latency_s":1.121909} gitlab # [ 268.500205] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.861Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a0399a5a520bf349e9f5e5d1","created_at":"2026-08-23T07:15:02.718Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aebd8632a32b7873e706c35c9c7785f6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.726Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a0399a5a520bf349e9f5e5d1: done: 0.013516 sec","job_status":"done","queue_duration_s":1.121871,"scheduling_latency_s":1.121909,"redis_calls":7,"redis_duration_s":0.001642,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001178,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000464,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008268,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013516,"completed_at":"2026-08-23T07:15:03.861Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.540490] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"85bed3b4269785fe27b94682","created_at":"2026-08-23T07:15:02.746Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67c7d203b56921e6b7b2514803bc825c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.766Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-85bed3b4269785fe27b94682: start","job_status":"start","queue_duration_s":1.097348,"scheduling_latency_s":1.097364} gitlab # [ 268.553513] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.891Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"85bed3b4269785fe27b94682","created_at":"2026-08-23T07:15:02.746Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"67c7d203b56921e6b7b2514803bc825c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.766Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-85bed3b4269785fe27b94682: done: 0.027741 sec","job_status":"done","queue_duration_s":1.097348,"scheduling_latency_s":1.097364,"redis_calls":11,"redis_duration_s":0.002753,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000494,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001493,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000766,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003276,"duration_s":0.027741,"completed_at":"2026-08-23T07:15:03.891Z","load_balancing_strategy":"primary","db_duration_s":0.005931,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.594270] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.892Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7529b7d856fe3c1a758e1a4f","created_at":"2026-08-23T07:15:02.789Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a056e8209244acec2c87542fcf20d679","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.798Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7529b7d856fe3c1a758e1a4f: start","job_status":"start","queue_duration_s":1.09431,"scheduling_latency_s":1.094327} gitlab # [ 268.608793] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.905Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"7529b7d856fe3c1a758e1a4f","created_at":"2026-08-23T07:15:02.789Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a056e8209244acec2c87542fcf20d679","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.798Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-7529b7d856fe3c1a758e1a4f: done: 0.01326 sec","job_status":"done","queue_duration_s":1.09431,"scheduling_latency_s":1.094327,"redis_calls":7,"redis_duration_s":0.0016489999999999999,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000478,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01326,"completed_at":"2026-08-23T07:15:03.905Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.650387] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.907Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"aa59a8a5cbb169deb5464766","created_at":"2026-08-23T07:15:02.820Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3595ac288167b2e00672538e0dcd159d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.830Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-aa59a8a5cbb169deb5464766: start","job_status":"start","queue_duration_s":1.076573,"scheduling_latency_s":1.076589} gitlab # [ 268.664074] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.934Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"aa59a8a5cbb169deb5464766","created_at":"2026-08-23T07:15:02.820Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3595ac288167b2e00672538e0dcd159d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.830Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-aa59a8a5cbb169deb5464766: done: 0.027323 sec","job_status":"done","queue_duration_s":1.076573,"scheduling_latency_s":1.076589,"redis_calls":14,"redis_duration_s":0.00341,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000318,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002276,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000816,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027323,"completed_at":"2026-08-23T07:15:03.934Z","load_balancing_strategy":"primary","db_duration_s":0.002153,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.705041] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.936Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"6579447c36c27b7a9ac31d16","created_at":"2026-08-23T07:15:02.851Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff7b67e652007902377d0efc7e6ec09a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.861Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-6579447c36c27b7a9ac31d16: start","job_status":"start","queue_duration_s":1.074993,"scheduling_latency_s":1.07501} gitlab # [ 268.718592] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.953Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"6579447c36c27b7a9ac31d16","created_at":"2026-08-23T07:15:02.851Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ff7b67e652007902377d0efc7e6ec09a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.861Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-6579447c36c27b7a9ac31d16: done: 0.017962 sec","job_status":"done","queue_duration_s":1.074993,"scheduling_latency_s":1.07501,"redis_calls":9,"redis_duration_s":0.002366,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001238,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001128,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005383,"exclusive_lock_hold_duration_s":0.00386148,"duration_s":0.017962,"completed_at":"2026-08-23T07:15:03.953Z","load_balancing_strategy":"primary","db_duration_s":0.00159,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.758331] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"40ab03180d88bb807d7b3287","created_at":"2026-08-23T07:15:02.887Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3ef2f10fff879f7c748cab34373d293","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.897Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-40ab03180d88bb807d7b3287: start","job_status":"start","queue_duration_s":1.057825,"scheduling_latency_s":1.057842} gitlab # [ 268.772471] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.978Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"40ab03180d88bb807d7b3287","created_at":"2026-08-23T07:15:02.887Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f3ef2f10fff879f7c748cab34373d293","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.897Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-40ab03180d88bb807d7b3287: done: 0.022804 sec","job_status":"done","queue_duration_s":1.057825,"scheduling_latency_s":1.057842,"redis_calls":9,"redis_duration_s":0.0065780000000000005,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.005372,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001206,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010684,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00062154,"exclusive_lock_hold_duration_s":0.00366644,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.022804,"completed_at":"2026-08-23T07:15:03.978Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001906,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.813845] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cd13c93d884a592b4a55d57","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cd13c93d884a592b4a55d57: start","job_status":"start","queue_duration_s":1.076598,"scheduling_latency_s":1.076614} gitlab # [ 268.826251] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cd13c93d884a592b4a55d57","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cd13c93d884a592b4a55d57: done: 0.016595 sec","job_status":"done","queue_duration_s":1.076598,"scheduling_latency_s":1.076614,"redis_calls":13,"redis_duration_s":0.003164,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001284,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00188,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010251,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016595,"completed_at":"2026-08-23T07:15:03.996Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.866339] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:03.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b0d5faecf78beeecdf389a9","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b0d5faecf78beeecdf389a9: start","job_status":"start","queue_duration_s":1.094618,"scheduling_latency_s":1.094635} gitlab # [ 268.878811] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b0d5faecf78beeecdf389a9","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b0d5faecf78beeecdf389a9: done: 0.015225 sec","job_status":"done","queue_duration_s":1.094618,"scheduling_latency_s":1.094635,"redis_calls":13,"redis_duration_s":0.002708,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001773,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015225,"completed_at":"2026-08-23T07:15:04.012Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.917586] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ea3b8a84a8899d2e806f174","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ea3b8a84a8899d2e806f174: start","job_status":"start","queue_duration_s":1.11122,"scheduling_latency_s":1.111236} gitlab # [ 268.930098] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ea3b8a84a8899d2e806f174","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ea3b8a84a8899d2e806f174: done: 0.015115 sec","job_status":"done","queue_duration_s":1.11122,"scheduling_latency_s":1.111236,"redis_calls":13,"redis_duration_s":0.002631,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001733,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015115,"completed_at":"2026-08-23T07:15:04.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 268.968906] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d668f7f05e7ac150e416bb6","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d668f7f05e7ac150e416bb6: start","job_status":"start","queue_duration_s":1.128405,"scheduling_latency_s":1.128453} gitlab # [ 268.980912] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.070Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d668f7f05e7ac150e416bb6","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d668f7f05e7ac150e416bb6: done: 0.039281 sec","job_status":"done","queue_duration_s":1.128405,"scheduling_latency_s":1.128453,"redis_calls":13,"redis_duration_s":0.004327,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001454,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.039281,"completed_at":"2026-08-23T07:15:04.070Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.020322] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f84d4a17ce594cd64c361710","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f84d4a17ce594cd64c361710: start","job_status":"start","queue_duration_s":1.170235,"scheduling_latency_s":1.170272} gitlab # [ 269.032669] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.100Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f84d4a17ce594cd64c361710","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f84d4a17ce594cd64c361710: done: 0.02739 sec","job_status":"done","queue_duration_s":1.170235,"scheduling_latency_s":1.170272,"redis_calls":13,"redis_duration_s":0.002772,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001795,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02739,"completed_at":"2026-08-23T07:15:04.100Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.072469] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.102Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2926ef36b692cd3a6144defd","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2926ef36b692cd3a6144defd: start","job_status":"start","queue_duration_s":1.199247,"scheduling_latency_s":1.199273} gitlab # [ 269.085097] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2926ef36b692cd3a6144defd","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2926ef36b692cd3a6144defd: done: 0.023318 sec","job_status":"done","queue_duration_s":1.199247,"scheduling_latency_s":1.199273,"redis_calls":13,"redis_duration_s":0.002101,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001355,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023318,"completed_at":"2026-08-23T07:15:04.125Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.124536] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ad6db099e111f249a85b9f1","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ad6db099e111f249a85b9f1: start","job_status":"start","queue_duration_s":1.224146,"scheduling_latency_s":1.224173} gitlab # [ 269.137000] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ad6db099e111f249a85b9f1","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ad6db099e111f249a85b9f1: done: 0.019465 sec","job_status":"done","queue_duration_s":1.224146,"scheduling_latency_s":1.224173,"redis_calls":13,"redis_duration_s":0.001895,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000682,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001213,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019465,"completed_at":"2026-08-23T07:15:04.146Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.176400] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ec0c53f72a8f4d5ed1a18d6","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ec0c53f72a8f4d5ed1a18d6: start","job_status":"start","queue_duration_s":1.245014,"scheduling_latency_s":1.245036} gitlab # [ 269.188844] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ec0c53f72a8f4d5ed1a18d6","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ec0c53f72a8f4d5ed1a18d6: done: 0.019183 sec","job_status":"done","queue_duration_s":1.245014,"scheduling_latency_s":1.245036,"redis_calls":13,"redis_duration_s":0.001898,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001211,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013328,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019183,"completed_at":"2026-08-23T07:15:04.167Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.228385] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdd5f6d2517925aebeb7c9c7","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdd5f6d2517925aebeb7c9c7: start","job_status":"start","queue_duration_s":1.265696,"scheduling_latency_s":1.265718} gitlab # [ 269.240781] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cdd5f6d2517925aebeb7c9c7","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cdd5f6d2517925aebeb7c9c7: done: 0.016656 sec","job_status":"done","queue_duration_s":1.265696,"scheduling_latency_s":1.265718,"redis_calls":13,"redis_duration_s":0.00162,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016656,"completed_at":"2026-08-23T07:15:04.185Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.280903] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac0d6a6b19adf099bc64d82c","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac0d6a6b19adf099bc64d82c: start","job_status":"start","queue_duration_s":1.283506,"scheduling_latency_s":1.283525} gitlab # [ 269.293081] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac0d6a6b19adf099bc64d82c","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac0d6a6b19adf099bc64d82c: done: 0.015945 sec","job_status":"done","queue_duration_s":1.283506,"scheduling_latency_s":1.283525,"redis_calls":13,"redis_duration_s":0.001712,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000642,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015945,"completed_at":"2026-08-23T07:15:04.202Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.332291] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.203Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5741183b30347553930dad0","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5741183b30347553930dad0: start","job_status":"start","queue_duration_s":1.300797,"scheduling_latency_s":1.300814} gitlab # [ 269.344921] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5741183b30347553930dad0","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5741183b30347553930dad0: done: 0.015497 sec","job_status":"done","queue_duration_s":1.300797,"scheduling_latency_s":1.300814,"redis_calls":13,"redis_duration_s":0.001717,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001171,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015497,"completed_at":"2026-08-23T07:15:04.219Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.383650] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.220Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a793533a8936a3ec5a230833","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a793533a8936a3ec5a230833: start","job_status":"start","queue_duration_s":1.317709,"scheduling_latency_s":1.317728} gitlab # [ 269.396242] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a793533a8936a3ec5a230833","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a793533a8936a3ec5a230833: done: 0.015313 sec","job_status":"done","queue_duration_s":1.317709,"scheduling_latency_s":1.317728,"redis_calls":13,"redis_duration_s":0.001523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010488,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015313,"completed_at":"2026-08-23T07:15:04.236Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.434905] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.237Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aa82be71ade8f55708d7a6e","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aa82be71ade8f55708d7a6e: start","job_status":"start","queue_duration_s":1.334152,"scheduling_latency_s":1.33417} gitlab # [ 269.447419] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aa82be71ade8f55708d7a6e","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aa82be71ade8f55708d7a6e: done: 0.014473 sec","job_status":"done","queue_duration_s":1.334152,"scheduling_latency_s":1.33417,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014473,"completed_at":"2026-08-23T07:15:04.251Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.487478] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da543d6c95c00a762cef8005","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da543d6c95c00a762cef8005: start","job_status":"start","queue_duration_s":1.349695,"scheduling_latency_s":1.349713} gitlab # [ 269.500058] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da543d6c95c00a762cef8005","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da543d6c95c00a762cef8005: done: 0.022294 sec","job_status":"done","queue_duration_s":1.349695,"scheduling_latency_s":1.349713,"redis_calls":13,"redis_duration_s":0.001542,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000599,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022294,"completed_at":"2026-08-23T07:15:04.275Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.538762] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6b357127d8d66bc23910ef6","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6b357127d8d66bc23910ef6: start","job_status":"start","queue_duration_s":1.373141,"scheduling_latency_s":1.37316} gitlab # [ 269.551082] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.291Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6b357127d8d66bc23910ef6","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6b357127d8d66bc23910ef6: done: 0.014856 sec","job_status":"done","queue_duration_s":1.373141,"scheduling_latency_s":1.37316,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010149,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014856,"completed_at":"2026-08-23T07:15:04.291Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.589996] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c776fc58ec6ffa6d7d155055","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c776fc58ec6ffa6d7d155055: start","job_status":"start","queue_duration_s":1.389121,"scheduling_latency_s":1.389138} gitlab # [ 269.602184] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.307Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c776fc58ec6ffa6d7d155055","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c776fc58ec6ffa6d7d155055: done: 0.015514 sec","job_status":"done","queue_duration_s":1.389121,"scheduling_latency_s":1.389138,"redis_calls":13,"redis_duration_s":0.001606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000633,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000973,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015514,"completed_at":"2026-08-23T07:15:04.307Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.640695] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c07f0cbfb452b886b8ddd490","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c07f0cbfb452b886b8ddd490: start","job_status":"start","queue_duration_s":1.405867,"scheduling_latency_s":1.405886} gitlab # [ 269.653183] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c07f0cbfb452b886b8ddd490","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c07f0cbfb452b886b8ddd490: done: 0.014459 sec","job_status":"done","queue_duration_s":1.405867,"scheduling_latency_s":1.405886,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014459,"completed_at":"2026-08-23T07:15:04.323Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.693057] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.324Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bafcdfb9cfa6be00aaa48d0b","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bafcdfb9cfa6be00aaa48d0b: start","job_status":"start","queue_duration_s":1.421441,"scheduling_latency_s":1.421461} gitlab # [ 269.705848] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.338Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bafcdfb9cfa6be00aaa48d0b","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bafcdfb9cfa6be00aaa48d0b: done: 0.014332 sec","job_status":"done","queue_duration_s":1.421441,"scheduling_latency_s":1.421461,"redis_calls":13,"redis_duration_s":0.001453,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014332,"completed_at":"2026-08-23T07:15:04.338Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.744748] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.339Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"578be8f519eec9d5f18edcfb","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-578be8f519eec9d5f18edcfb: start","job_status":"start","queue_duration_s":1.436841,"scheduling_latency_s":1.436859} gitlab # [ 269.757028] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.354Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"578be8f519eec9d5f18edcfb","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-578be8f519eec9d5f18edcfb: done: 0.01473 sec","job_status":"done","queue_duration_s":1.436841,"scheduling_latency_s":1.436859,"redis_calls":13,"redis_duration_s":0.0014949999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01473,"completed_at":"2026-08-23T07:15:04.354Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.796311] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.355Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dff0461443f26d963ae73f9","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dff0461443f26d963ae73f9: start","job_status":"start","queue_duration_s":1.452646,"scheduling_latency_s":1.452664} gitlab # [ 269.808550] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.370Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dff0461443f26d963ae73f9","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dff0461443f26d963ae73f9: done: 0.014454 sec","job_status":"done","queue_duration_s":1.452646,"scheduling_latency_s":1.452664,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014454,"completed_at":"2026-08-23T07:15:04.370Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.846860] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ac9b538948e6f1f21eda1a6","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ac9b538948e6f1f21eda1a6: start","job_status":"start","queue_duration_s":1.468191,"scheduling_latency_s":1.468209} gitlab # [ 269.859328] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5ac9b538948e6f1f21eda1a6","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5ac9b538948e6f1f21eda1a6: done: 0.014366 sec","job_status":"done","queue_duration_s":1.468191,"scheduling_latency_s":1.468209,"redis_calls":13,"redis_duration_s":0.001412,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014366,"completed_at":"2026-08-23T07:15:04.385Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.899108] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5671f07ac1f390b23bc2c19","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5671f07ac1f390b23bc2c19: start","job_status":"start","queue_duration_s":1.483641,"scheduling_latency_s":1.483658} gitlab # [ 269.911496] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5671f07ac1f390b23bc2c19","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5671f07ac1f390b23bc2c19: done: 0.015048 sec","job_status":"done","queue_duration_s":1.483641,"scheduling_latency_s":1.483658,"redis_calls":13,"redis_duration_s":0.001496,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015048,"completed_at":"2026-08-23T07:15:04.401Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 269.950994] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec30cac7e368ce2da5e8b1fa","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec30cac7e368ce2da5e8b1fa: start","job_status":"start","queue_duration_s":1.4998,"scheduling_latency_s":1.499818} gitlab # [ 269.963711] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec30cac7e368ce2da5e8b1fa","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec30cac7e368ce2da5e8b1fa: done: 0.014257 sec","job_status":"done","queue_duration_s":1.4998,"scheduling_latency_s":1.499818,"redis_calls":13,"redis_duration_s":0.0014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014257,"completed_at":"2026-08-23T07:15:04.417Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.003395] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c9a94d5305e51c7ac4b85ae","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c9a94d5305e51c7ac4b85ae: start","job_status":"start","queue_duration_s":1.515159,"scheduling_latency_s":1.515177} gitlab # [ 270.015718] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c9a94d5305e51c7ac4b85ae","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c9a94d5305e51c7ac4b85ae: done: 0.014319 sec","job_status":"done","queue_duration_s":1.515159,"scheduling_latency_s":1.515177,"redis_calls":13,"redis_duration_s":0.001419,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009869,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014319,"completed_at":"2026-08-23T07:15:04.432Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.054578] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c046ee190690887fdf9110b4","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c046ee190690887fdf9110b4: start","job_status":"start","queue_duration_s":1.530604,"scheduling_latency_s":1.530623} gitlab # [ 270.067791] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c046ee190690887fdf9110b4","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c046ee190690887fdf9110b4: done: 0.014579 sec","job_status":"done","queue_duration_s":1.530604,"scheduling_latency_s":1.530623,"redis_calls":13,"redis_duration_s":0.001472,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010056,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014579,"completed_at":"2026-08-23T07:15:04.448Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.106723] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.449Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48f86d166f5fa29522cbbb07","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48f86d166f5fa29522cbbb07: start","job_status":"start","queue_duration_s":1.546373,"scheduling_latency_s":1.546391} gitlab # [ 270.119197] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"48f86d166f5fa29522cbbb07","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-48f86d166f5fa29522cbbb07: done: 0.0143 sec","job_status":"done","queue_duration_s":1.546373,"scheduling_latency_s":1.546391,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0143,"completed_at":"2026-08-23T07:15:04.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.157774] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"744e4164fcef357dc217a5c3","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-744e4164fcef357dc217a5c3: start","job_status":"start","queue_duration_s":1.561746,"scheduling_latency_s":1.561764} gitlab # [ 270.169964] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"744e4164fcef357dc217a5c3","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-744e4164fcef357dc217a5c3: done: 0.014511 sec","job_status":"done","queue_duration_s":1.561746,"scheduling_latency_s":1.561764,"redis_calls":13,"redis_duration_s":0.001483,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014511,"completed_at":"2026-08-23T07:15:04.479Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.208465] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bbad84f505e2f196a392c5b","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bbad84f505e2f196a392c5b: start","job_status":"start","queue_duration_s":1.577394,"scheduling_latency_s":1.577413} gitlab # [ 270.220689] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.495Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bbad84f505e2f196a392c5b","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bbad84f505e2f196a392c5b: done: 0.014709 sec","job_status":"done","queue_duration_s":1.577394,"scheduling_latency_s":1.577413,"redis_calls":13,"redis_duration_s":0.001506,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009868,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014709,"completed_at":"2026-08-23T07:15:04.495Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.259136] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4693b2a251fe2d21f006a18","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4693b2a251fe2d21f006a18: start","job_status":"start","queue_duration_s":1.593151,"scheduling_latency_s":1.593169} gitlab # [ 270.272474] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4693b2a251fe2d21f006a18","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4693b2a251fe2d21f006a18: done: 0.014626 sec","job_status":"done","queue_duration_s":1.593151,"scheduling_latency_s":1.593169,"redis_calls":13,"redis_duration_s":0.001505,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014626,"completed_at":"2026-08-23T07:15:04.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.311161] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"891b84bc8070f07eefec910f","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-891b84bc8070f07eefec910f: start","job_status":"start","queue_duration_s":1.608901,"scheduling_latency_s":1.608919} gitlab # [ 270.323395] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.526Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"891b84bc8070f07eefec910f","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-891b84bc8070f07eefec910f: done: 0.01442 sec","job_status":"done","queue_duration_s":1.608901,"scheduling_latency_s":1.608919,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009878,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01442,"completed_at":"2026-08-23T07:15:04.526Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.362433] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5e3e9d95f097fb7fe93a5a6","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5e3e9d95f097fb7fe93a5a6: start","job_status":"start","queue_duration_s":1.624393,"scheduling_latency_s":1.624411} gitlab # [ 270.374938] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.541Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5e3e9d95f097fb7fe93a5a6","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5e3e9d95f097fb7fe93a5a6: done: 0.014354 sec","job_status":"done","queue_duration_s":1.624393,"scheduling_latency_s":1.624411,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014354,"completed_at":"2026-08-23T07:15:04.541Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.413899] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.542Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b061f73dc91763a4167f4958","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b061f73dc91763a4167f4958: start","job_status":"start","queue_duration_s":1.639808,"scheduling_latency_s":1.639825} gitlab # [ 270.426743] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.557Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b061f73dc91763a4167f4958","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b061f73dc91763a4167f4958: done: 0.014744 sec","job_status":"done","queue_duration_s":1.639808,"scheduling_latency_s":1.639825,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014744,"completed_at":"2026-08-23T07:15:04.557Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.465843] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"324960167e3baf4f737ad69f","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-324960167e3baf4f737ad69f: start","job_status":"start","queue_duration_s":1.655643,"scheduling_latency_s":1.655661} gitlab # [ 270.479122] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.573Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"324960167e3baf4f737ad69f","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-324960167e3baf4f737ad69f: done: 0.0143 sec","job_status":"done","queue_duration_s":1.655643,"scheduling_latency_s":1.655661,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0143,"completed_at":"2026-08-23T07:15:04.573Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.518183] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ad6e172c7cb2887a403da01","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ad6e172c7cb2887a403da01: start","job_status":"start","queue_duration_s":1.671053,"scheduling_latency_s":1.671072} gitlab # [ 270.530331] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0ad6e172c7cb2887a403da01","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0ad6e172c7cb2887a403da01: done: 0.014438 sec","job_status":"done","queue_duration_s":1.671053,"scheduling_latency_s":1.671072,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014438,"completed_at":"2026-08-23T07:15:04.588Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.569225] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.589Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94c0aec0cb9324338d2df49e","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94c0aec0cb9324338d2df49e: start","job_status":"start","queue_duration_s":1.686643,"scheduling_latency_s":1.686662} gitlab # [ 270.581421] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94c0aec0cb9324338d2df49e","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94c0aec0cb9324338d2df49e: done: 0.014715 sec","job_status":"done","queue_duration_s":1.686643,"scheduling_latency_s":1.686662,"redis_calls":13,"redis_duration_s":0.001621,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000708,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014715,"completed_at":"2026-08-23T07:15:04.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.621083] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.605Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80fd94c42b496cd36bb284e5","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80fd94c42b496cd36bb284e5: start","job_status":"start","queue_duration_s":1.702504,"scheduling_latency_s":1.702522} gitlab # [ 270.633593] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.619Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"80fd94c42b496cd36bb284e5","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-80fd94c42b496cd36bb284e5: done: 0.014288 sec","job_status":"done","queue_duration_s":1.702504,"scheduling_latency_s":1.702522,"redis_calls":13,"redis_duration_s":0.001409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014288,"completed_at":"2026-08-23T07:15:04.619Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.672952] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eebe8d6e7b64f66725435ab1","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eebe8d6e7b64f66725435ab1: start","job_status":"start","queue_duration_s":1.717902,"scheduling_latency_s":1.71792} gitlab # [ 270.686336] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.635Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eebe8d6e7b64f66725435ab1","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eebe8d6e7b64f66725435ab1: done: 0.01456 sec","job_status":"done","queue_duration_s":1.717902,"scheduling_latency_s":1.71792,"redis_calls":13,"redis_duration_s":0.001533,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000562,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01456,"completed_at":"2026-08-23T07:15:04.635Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.726082] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.636Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2939cd8fdd2a188a1425373","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2939cd8fdd2a188a1425373: start","job_status":"start","queue_duration_s":1.733589,"scheduling_latency_s":1.733608} gitlab # [ 270.738698] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.651Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d2939cd8fdd2a188a1425373","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d2939cd8fdd2a188a1425373: done: 0.014329 sec","job_status":"done","queue_duration_s":1.733589,"scheduling_latency_s":1.733608,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014329,"completed_at":"2026-08-23T07:15:04.650Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.778033] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.652Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"686d3c4300628642453df712","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-686d3c4300628642453df712: start","job_status":"start","queue_duration_s":1.749093,"scheduling_latency_s":1.749111} gitlab # [ 270.790254] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.666Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"686d3c4300628642453df712","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-686d3c4300628642453df712: done: 0.014378 sec","job_status":"done","queue_duration_s":1.749093,"scheduling_latency_s":1.749111,"redis_calls":13,"redis_duration_s":0.0014169999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000899,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014378,"completed_at":"2026-08-23T07:15:04.666Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.829615] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb4af3702f52c2330a17df97","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb4af3702f52c2330a17df97: start","job_status":"start","queue_duration_s":1.764697,"scheduling_latency_s":1.764715} gitlab # [ 270.841995] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb4af3702f52c2330a17df97","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb4af3702f52c2330a17df97: done: 0.014624 sec","job_status":"done","queue_duration_s":1.764697,"scheduling_latency_s":1.764715,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014624,"completed_at":"2026-08-23T07:15:04.682Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.881958] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.683Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24ebffc187782ab84ca27cf1","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24ebffc187782ab84ca27cf1: start","job_status":"start","queue_duration_s":1.780395,"scheduling_latency_s":1.780413} gitlab # [ 270.894610] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"24ebffc187782ab84ca27cf1","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-24ebffc187782ab84ca27cf1: done: 0.014619 sec","job_status":"done","queue_duration_s":1.780395,"scheduling_latency_s":1.780413,"redis_calls":13,"redis_duration_s":0.0014299999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009848,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014619,"completed_at":"2026-08-23T07:15:04.698Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.933952] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d78d46a15c1965a7ab732033","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d78d46a15c1965a7ab732033: start","job_status":"start","queue_duration_s":1.79614,"scheduling_latency_s":1.796158} gitlab # [ 270.946247] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d78d46a15c1965a7ab732033","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d78d46a15c1965a7ab732033: done: 0.01456 sec","job_status":"done","queue_duration_s":1.79614,"scheduling_latency_s":1.796158,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009988,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01456,"completed_at":"2026-08-23T07:15:04.713Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 270.985423] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.715Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03aa6907994402d8f3a6b54a","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03aa6907994402d8f3a6b54a: start","job_status":"start","queue_duration_s":1.811865,"scheduling_latency_s":1.811883} gitlab # [ 270.997917] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03aa6907994402d8f3a6b54a","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03aa6907994402d8f3a6b54a: done: 0.014532 sec","job_status":"done","queue_duration_s":1.811865,"scheduling_latency_s":1.811883,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014532,"completed_at":"2026-08-23T07:15:04.729Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.036794] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a2d8914e963482713976635","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a2d8914e963482713976635: start","job_status":"start","queue_duration_s":1.827479,"scheduling_latency_s":1.827496} gitlab # [ 271.049204] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5a2d8914e963482713976635","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5a2d8914e963482713976635: done: 0.014308 sec","job_status":"done","queue_duration_s":1.827479,"scheduling_latency_s":1.827496,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014308,"completed_at":"2026-08-23T07:15:04.744Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.089551] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5eacccb0588ad6181fd50c2a","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5eacccb0588ad6181fd50c2a: start","job_status":"start","queue_duration_s":1.842913,"scheduling_latency_s":1.842931} gitlab # [ 271.101702] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5eacccb0588ad6181fd50c2a","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5eacccb0588ad6181fd50c2a: done: 0.014628 sec","job_status":"done","queue_duration_s":1.842913,"scheduling_latency_s":1.842931,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014628,"completed_at":"2026-08-23T07:15:04.760Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.141045] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7b1dac1f3c0166bcbe319e7","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7b1dac1f3c0166bcbe319e7: start","job_status":"start","queue_duration_s":1.85865,"scheduling_latency_s":1.858668} gitlab # [ 271.153164] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.776Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7b1dac1f3c0166bcbe319e7","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7b1dac1f3c0166bcbe319e7: done: 0.014356 sec","job_status":"done","queue_duration_s":1.85865,"scheduling_latency_s":1.858668,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014356,"completed_at":"2026-08-23T07:15:04.776Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.192563] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f1d6c20340b08cc41c9ddbb","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f1d6c20340b08cc41c9ddbb: start","job_status":"start","queue_duration_s":1.874185,"scheduling_latency_s":1.874203} gitlab # [ 271.204912] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.791Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7f1d6c20340b08cc41c9ddbb","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7f1d6c20340b08cc41c9ddbb: done: 0.014243 sec","job_status":"done","queue_duration_s":1.874185,"scheduling_latency_s":1.874203,"redis_calls":13,"redis_duration_s":0.0014399999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014243,"completed_at":"2026-08-23T07:15:04.791Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.244085] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.792Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90d13262cd558f73008f0ccb","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90d13262cd558f73008f0ccb: start","job_status":"start","queue_duration_s":1.889538,"scheduling_latency_s":1.889557} gitlab # [ 271.256461] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.807Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90d13262cd558f73008f0ccb","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90d13262cd558f73008f0ccb: done: 0.014903 sec","job_status":"done","queue_duration_s":1.889538,"scheduling_latency_s":1.889557,"redis_calls":13,"redis_duration_s":0.001775,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014903,"completed_at":"2026-08-23T07:15:04.807Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.296722] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdd122b808ff92d85f732e03","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdd122b808ff92d85f732e03: start","job_status":"start","queue_duration_s":1.90554,"scheduling_latency_s":1.905558} gitlab # [ 271.309193] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.823Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdd122b808ff92d85f732e03","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdd122b808ff92d85f732e03: done: 0.01466 sec","job_status":"done","queue_duration_s":1.90554,"scheduling_latency_s":1.905558,"redis_calls":13,"redis_duration_s":0.001512,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01466,"completed_at":"2026-08-23T07:15:04.823Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.348426] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"571ad44d8cb850ef7e5fa05d","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-571ad44d8cb850ef7e5fa05d: start","job_status":"start","queue_duration_s":1.921276,"scheduling_latency_s":1.921293} gitlab # [ 271.360667] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"571ad44d8cb850ef7e5fa05d","created_at":"2026-08-23T07:15:02.546Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-46e23f6b393e4259","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a5ad48457006f1a3cd308cf979f17d81","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.903Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-571ad44d8cb850ef7e5fa05d: done: 0.014405 sec","job_status":"done","queue_duration_s":1.921276,"scheduling_latency_s":1.921293,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014405,"completed_at":"2026-08-23T07:15:04.838Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.400072] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.840Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1ca94ae52b4d2cad1c66cb99","created_at":"2026-08-23T07:15:02.929Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a3e023cccfa3336fb8aed32666c460c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.940Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1ca94ae52b4d2cad1c66cb99: start","job_status":"start","queue_duration_s":1.899991,"scheduling_latency_s":1.90001} gitlab # [ 271.414679] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.847Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 271.418065] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.852Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"1ca94ae52b4d2cad1c66cb99","created_at":"2026-08-23T07:15:02.929Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2a3e023cccfa3336fb8aed32666c460c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.940Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-1ca94ae52b4d2cad1c66cb99: done: 0.012718 sec","job_status":"done","queue_duration_s":1.899991,"scheduling_latency_s":1.90001,"redis_calls":7,"redis_duration_s":0.0009559999999999999,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000685,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000271,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012718,"completed_at":"2026-08-23T07:15:04.852Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.459249] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.853Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c636a16aa99dab1bf7bf1ae6","created_at":"2026-08-23T07:15:02.958Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27b374ec985a048eb03ad3e98676092f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.965Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c636a16aa99dab1bf7bf1ae6: start","job_status":"start","queue_duration_s":1.88854,"scheduling_latency_s":1.888558} gitlab # [ 271.473790] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.870Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"c636a16aa99dab1bf7bf1ae6","created_at":"2026-08-23T07:15:02.958Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27b374ec985a048eb03ad3e98676092f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:02.965Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-c636a16aa99dab1bf7bf1ae6: done: 0.016844 sec","job_status":"done","queue_duration_s":1.88854,"scheduling_latency_s":1.888558,"redis_calls":8,"redis_duration_s":0.001099,"redis_read_bytes":133,"redis_write_bytes":730,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000142,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":49,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000261,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016844,"completed_at":"2026-08-23T07:15:04.870Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002132,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.516652] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.871Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f6c76c6eec305ba5ee22c30a","created_at":"2026-08-23T07:15:03.064Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6501780b7f8016019243356b23d6cb3","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.073Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f6c76c6eec305ba5ee22c30a: start","job_status":"start","queue_duration_s":1.798772,"scheduling_latency_s":1.798792} gitlab # [ 271.530900] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.894Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"f6c76c6eec305ba5ee22c30a","created_at":"2026-08-23T07:15:03.064Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6501780b7f8016019243356b23d6cb3","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.073Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-f6c76c6eec305ba5ee22c30a: done: 0.022698 sec","job_status":"done","queue_duration_s":1.798772,"scheduling_latency_s":1.798792,"redis_calls":7,"redis_duration_s":0.000977,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000718,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022698,"completed_at":"2026-08-23T07:15:04.894Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006674,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.571658] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:04.895Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"52cc1543a9971727023418de","created_at":"2026-08-23T07:15:03.092Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddd524e69c825e031b36f5d62a513dba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.101Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-52cc1543a9971727023418de: start","job_status":"start","queue_duration_s":1.794085,"scheduling_latency_s":1.794104} gitlab # [ 271.586104] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.286Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"52cc1543a9971727023418de","created_at":"2026-08-23T07:15:03.092Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddd524e69c825e031b36f5d62a513dba","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.101Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-52cc1543a9971727023418de: done: 0.390607 sec","job_status":"done","queue_duration_s":1.794085,"scheduling_latency_s":1.794104,"redis_calls":9,"redis_duration_s":0.001498,"redis_read_bytes":7,"redis_write_bytes":987,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.069,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.069,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.287592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047322,"exclusive_lock_hold_duration_s":0.3754876,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.390607,"completed_at":"2026-08-23T07:15:05.286Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.120754,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.628885] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"1dfb674af6cdd7056428ab16","created_at":"2026-08-23T07:15:03.126Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48d9b13073450533ad210974fc3a625b","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.157Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-1dfb674af6cdd7056428ab16: start","job_status":"start","queue_duration_s":2.13091,"scheduling_latency_s":2.130931} gitlab # [ 271.643139] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"1dfb674af6cdd7056428ab16","created_at":"2026-08-23T07:15:03.126Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"48d9b13073450533ad210974fc3a625b","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.157Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-1dfb674af6cdd7056428ab16: done: 0.02449 sec","job_status":"done","queue_duration_s":2.13091,"scheduling_latency_s":2.130931,"redis_calls":11,"redis_duration_s":0.001439,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000744,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000413,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012152,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002355,"duration_s":0.02449,"completed_at":"2026-08-23T07:15:05.312Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004797,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.685900] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"08b3fb537d2262bce1c193a3","created_at":"2026-08-23T07:15:03.173Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0eb8d17940f187e70c4dbceef33ce76","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.180Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-08b3fb537d2262bce1c193a3: start","job_status":"start","queue_duration_s":2.13333,"scheduling_latency_s":2.133348} gitlab # [ 271.701615] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.355Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"08b3fb537d2262bce1c193a3","created_at":"2026-08-23T07:15:03.173Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-68fbbef510564752","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d0eb8d17940f187e70c4dbceef33ce76","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.180Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-08b3fb537d2262bce1c193a3: done: 0.042009 sec","job_status":"done","queue_duration_s":2.13333,"scheduling_latency_s":2.133348,"redis_calls":9,"redis_duration_s":0.001343,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000656,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051902,"exclusive_lock_hold_duration_s":0.02717394,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.042009,"completed_at":"2026-08-23T07:15:05.355Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018299,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.745538] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.357Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6bc498e7bcd790eb8cce9b6f","created_at":"2026-08-23T07:15:03.919Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-f866822217184158","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3595ac288167b2e00672538e0dcd159d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.929Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6bc498e7bcd790eb8cce9b6f: start","job_status":"start","queue_duration_s":1.428409,"scheduling_latency_s":1.428428} gitlab # [ 271.758265] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.370Z","message":"No existing merge request to be cleaned up."} gitlab # [ 271.759948] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.378Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"6bc498e7bcd790eb8cce9b6f","created_at":"2026-08-23T07:15:03.919Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-f866822217184158","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3595ac288167b2e00672538e0dcd159d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.929Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-6bc498e7bcd790eb8cce9b6f: done: 0.021002 sec","job_status":"done","queue_duration_s":1.428409,"scheduling_latency_s":1.428428,"redis_calls":10,"redis_duration_s":0.001361,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000803,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021002,"completed_at":"2026-08-23T07:15:05.378Z","load_balancing_strategy":"primary","db_duration_s":0.002795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.799055] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.379Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9ce76c9e49b8893153c39416","created_at":"2026-08-23T07:15:03.919Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-f866822217184158","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3595ac288167b2e00672538e0dcd159d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.929Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9ce76c9e49b8893153c39416: start","job_status":"start","queue_duration_s":1.45049,"scheduling_latency_s":1.450507} gitlab # [ 271.811592] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.391Z","message":"No existing merge request to be cleaned up."} gitlab # [ 271.813364] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.400Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9ce76c9e49b8893153c39416","created_at":"2026-08-23T07:15:03.919Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-f866822217184158","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3595ac288167b2e00672538e0dcd159d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.929Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9ce76c9e49b8893153c39416: done: 0.020454 sec","job_status":"done","queue_duration_s":1.45049,"scheduling_latency_s":1.450507,"redis_calls":10,"redis_duration_s":0.001486,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000632,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000854,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014246,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020454,"completed_at":"2026-08-23T07:15:05.400Z","load_balancing_strategy":"primary","db_duration_s":0.002777,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.851510] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.401Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e363fd4e4b6d4c4d7c5f1b0c","created_at":"2026-08-23T07:15:03.919Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-f866822217184158","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3595ac288167b2e00672538e0dcd159d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.929Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e363fd4e4b6d4c4d7c5f1b0c: start","job_status":"start","queue_duration_s":1.47205,"scheduling_latency_s":1.472068} gitlab # [ 271.864112] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.413Z","message":"No existing merge request to be cleaned up."} gitlab # [ 271.865747] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.422Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e363fd4e4b6d4c4d7c5f1b0c","created_at":"2026-08-23T07:15:03.919Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-f866822217184158","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3595ac288167b2e00672538e0dcd159d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.929Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e363fd4e4b6d4c4d7c5f1b0c: done: 0.021703 sec","job_status":"done","queue_duration_s":1.47205,"scheduling_latency_s":1.472068,"redis_calls":10,"redis_duration_s":0.001326,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000563,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000763,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021703,"completed_at":"2026-08-23T07:15:05.422Z","load_balancing_strategy":"primary","db_duration_s":0.002337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 271.904853] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.424Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3bfa34e99f9a6b708ed46e08","created_at":"2026-08-23T07:15:03.919Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-f866822217184158","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3595ac288167b2e00672538e0dcd159d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.929Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3bfa34e99f9a6b708ed46e08: start","job_status":"start","queue_duration_s":1.494851,"scheduling_latency_s":1.494869} gitlab # [ 271.917326] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.434Z","message":"No existing merge request to be cleaned up."} gitlab # [ 271.918971] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:05.444Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3bfa34e99f9a6b708ed46e08","created_at":"2026-08-23T07:15:03.919Z","trace_propagation_headers":{"sentry-trace":"d48a8a94790c47388442163bfa3a08bd-f866822217184158","baggage":"sentry-trace_id=d48a8a94790c47388442163bfa3a08bd,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3595ac288167b2e00672538e0dcd159d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:03.929Z","job_size_bytes":2,"pid":2005,"sidekiq_tid":"map5","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3bfa34e99f9a6b708ed46e08: done: 0.020015 sec","job_status":"done","queue_duration_s":1.494851,"scheduling_latency_s":1.494869,"redis_calls":10,"redis_duration_s":0.001415,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000835,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020015,"completed_at":"2026-08-23T07:15:05.443Z","load_balancing_strategy":"primary","db_duration_s":0.002527,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 307.553426] postgres[3253]: [3253] ERROR: relation "table_without_models" does not exist gitlab # [ 307.562856] postgres[3253]: [3253] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 309.213450] redis[790]: 10 changes in 300 seconds. Saving... gitlab # [ 309.213939] redis[790]: Background saving started by pid 3284 gitlab # [ 309.225189] redis[3284]: BGSAVE done, 483 keys saved, 0 keys skipped, 122992 bytes written. gitlab # [ 309.231826] redis[3284]: DB saved on disk gitlab # [ 309.234227] redis[3284]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB gitlab # [ 309.314548] redis[790]: Background saving terminated with success gitlab # [ 310.892997] postgres[858]: [858] LOG: checkpoint starting: time gitlab # [ 311.787443] gitaly[890]: time="2026-08-23T07:15:47.643Z" level=info msg="burden monitor stats" pid=890 gitlab # [ 313.343090] runuser[2928]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 313.344647] setup-gitlab-start[2906]: + systemctl restart gitlab-sidekiq.service gitlab # [ 313.379185] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 313.381882] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:49.237Z","message":"Shutting down"} gitlab # [ 313.386705] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:49.243Z","message":"Scheduler exiting..."} gitlab # [ 313.388330] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:49.243Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 313.394146] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:49.251Z","message":"Scheduler exiting..."} gitlab # [ 313.900910] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:49.757Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 315.405981] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:51.261Z","message":"Bye!"} gitlab # [ 315.453963] sidekiq-cluster[2005]: {"severity":"INFO","time":"2026-08-23T07:15:51.310Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2005,"worker_id":"sidekiq_0","memwd_rss_bytes":957329408,"retry":0} gitlab # [ 316.969292] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 316.969659] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 316.969974] systemd[1]: gitlab-sidekiq.service: Consumed 1min 48.510s CPU time over 3min 15.339s wall clock time, 948.4M memory peak, 4.5M read from disk. gitlab # [ 316.983459] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 316.987084] setup-gitlab-start[2906]: + mkdir -p /var/lib/secrets gitlab # [ 316.992120] setup-gitlab-start[2906]: + echo nixbot-test-token-of-20-chars gitlab # [ 316.995927] setup-gitlab-start[2906]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 316.999048] setup-gitlab-start[2906]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 318.509428] gitaly[890]: time="2026-08-23T07:15:54.364Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:16:04.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:54.364" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 318.509892] gitaly[890]: time="2026-08-23T07:15:54.365Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:16:04.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:54.364" grpc.time_ms=0.658 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 318.803669] gitaly[890]: time="2026-08-23T07:15:54.660Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:16:04.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:54.660" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 318.835352] gitaly[890]: time="2026-08-23T07:15:54.660Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:16:04.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:54.660" grpc.time_ms=0.551 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 318.881399] gitaly[890]: time="2026-08-23T07:15:54.738Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 diskcache=c459145c-0963-4175-8a98-331139a99d11 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T07:16:04.025" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:54.676" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 318.909224] gitaly[890]: time="2026-08-23T07:15:54.739Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=35 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=39 command.spawn_token_fork_ms=3 command.system_time_ms=32 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T07:16:04.025" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:54.676" grpc.time_ms=62.198 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 318.933659] gitaly[890]: time="2026-08-23T07:15:54.764Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:16:04.112" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:54.762" pid=890 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 318.948773] gitaly[890]: time="2026-08-23T07:15:54.764Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:16:04.112" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:54.762" grpc.time_ms=1.275 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 318.963616] gitaly[890]: time="2026-08-23T07:15:54.789Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:16:04.122" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:54.773" grpc.time_ms=16.438 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.088540] gitaly[890]: time="2026-08-23T07:15:54.945Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:16:04.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:54.944" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.120408] gitaly[890]: time="2026-08-23T07:15:54.945Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:16:04.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:54.944" grpc.time_ms=0.661 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.156802] gitaly[890]: time="2026-08-23T07:15:55.013Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 diskcache=a744157d-3517-478f-89f6-adba90ee4d99 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T07:16:04.009" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:54.950" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.186689] gitaly[890]: time="2026-08-23T07:15:55.014Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=36 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=43 command.spawn_token_fork_ms=4 command.system_time_ms=36 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-23T07:16:04.009" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:54.950" grpc.time_ms=63.662 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.213283] gitaly[890]: time="2026-08-23T07:15:55.023Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:16:05.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:55.022" pid=890 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 319.229229] gitaly[890]: time="2026-08-23T07:15:55.024Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:16:05.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:55.022" grpc.time_ms=1.283 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.244898] gitaly[890]: time="2026-08-23T07:15:55.044Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:16:05.010" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:55.030" grpc.time_ms=13.663 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.263775] gitaly[890]: time="2026-08-23T07:15:55.098Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:16:05.077" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:55.097" grpc.time_ms=0.28 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 319.277773] gitaly[890]: time="2026-08-23T07:15:55.115Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T07:16:05.094" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:55.114" grpc.time_ms=0.496 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 320.124446] gitaly[890]: time="2026-08-23T07:15:55.980Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKKXHJHYMZ4H7RRXFV7W4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:16:05.021" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:55.962" grpc.time_ms=17.755 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 320.816956] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:15:56 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 3790 gitlab # [ 320.821844] setup-gitlab-start[2906]: + mkdir -p /tmp/test-flake gitlab # [ 320.825741] setup-gitlab-start[2906]: + cd /tmp/test-flake gitlab # [ 320.830272] setup-gitlab-start[2906]: + git init -b master gitlab # [ 320.854727] setup-gitlab-start[3374]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 320.858435] setup-gitlab-start[2906]: + git config user.name test gitlab # [ 320.862170] setup-gitlab-start[2906]: + git config user.email test@example.com gitlab # [ 320.869320] setup-gitlab-start[2906]: + cat gitlab # [ 320.874851] setup-gitlab-start[2906]: + git add flake.nix gitlab # [ 320.883579] setup-gitlab-start[2906]: + git commit -m 'initial commit' gitlab # [ 320.910512] setup-gitlab-start[3379]: [master (root-commit) 1f8ec03] initial commit gitlab # [ 320.914751] setup-gitlab-start[3379]: 1 file changed, 10 insertions(+) gitlab # [ 320.917756] setup-gitlab-start[3379]: create mode 100644 flake.nix gitlab # [ 320.920373] setup-gitlab-start[2906]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 320.925217] setup-gitlab-start[2906]: + git push -u origin master gitlab # [ 321.050596] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:15:56 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 84 gitlab # [ 321.558949] gitaly[890]: time="2026-08-23T07:15:57.414Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKQVDMQKN5210XVYJZQH2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:15:57.397" grpc.time_ms=17.187 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 321.598110] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:15:57 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 507 gitlab # [ 321.980139] sidekiq-cluster[3318]: {"severity":"INFO","time":"2026-08-23T07:15:57.808Z","message":"Starting cluster with 1 processes"} gitlab # [ 322.038021] gitaly[890]: time="2026-08-23T07:15:57.894Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:16:07.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:57.881" grpc.time_ms=13.075 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 322.085049] gitaly[890]: time="2026-08-23T07:15:57.942Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-23T07:16:27.033" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-23T07:15:57.933" grpc.time_ms=8.29 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 322.143444] gitaly[890]: time="2026-08-23T07:15:58.000Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF duration_ms=314ns method=POST pid=890 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 322.178741] gitaly[890]: time="2026-08-23T07:15:58.035Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF duration_ms=34ns method=POST pid=890 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 322.187897] gitaly[890]: time="2026-08-23T07:15:58.036Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:15:57.684" grpc.time_ms=351.243 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 322.233912] gitaly[890]: time="2026-08-23T07:15:58.090Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:15:58.089" grpc.time_ms=1.304 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 322.315456] gitaly[890]: time="2026-08-23T07:15:58.172Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:15:58.171" grpc.time_ms=1.019 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 322.359029] gitaly[890]: time="2026-08-23T07:15:58.216Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:15:58.215" grpc.time_ms=0.743 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 322.553118] gitaly[890]: time="2026-08-23T07:15:58.409Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:16:08.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:15:58.393" grpc.time_ms=16.51 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 322.593527] gitaly[890]: time="2026-08-23T07:15:58.446Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=4 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-23T07:16:08.028" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:15:58.420" grpc.time_ms=26.1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 322.619378] gitaly[890]: time="2026-08-23T07:15:58.460Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF duration_ms=198ns method=POST pid=890 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 322.624428] gitaly[890]: time="2026-08-23T07:15:58.461Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:15:58.260" grpc.time_ms=200.26 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 322.641271] gitaly[890]: time="2026-08-23T07:15:58.478Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF diskcache=6eeb2650-7aed-4c13-8a43-c3c3ca733c09 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:15:57.585" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 322.658071] systemd[1]: Finished setup-gitlab.service. gitlab # [ 322.659824] gitlab-workhorse[817]: time="2026-08-23T07:15:58Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 322.662676] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:15:58 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1009 gitlab # [ 322.665611] setup-gitlab-start[3383]: To http://gitlab/root/test-flake.git gitlab # [ 322.666887] setup-gitlab-start[3383]: * [new branch] master -> master gitlab # [ 322.668153] setup-gitlab-start[3383]: branch 'master' set up to track 'origin/master'. gitlab # [ 322.669565] gitaly[890]: time="2026-08-23T07:15:58.478Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=307 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13472 command.oublock=32 command.real_time_ms=885 command.spawn_token_fork_ms=1 command.system_time_ms=153 command.user_time_ms=154 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:15:57.585" grpc.time_ms=893.004 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 322.686575] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 323.44 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 323.944423] nixbot[3473]: {"ts": "2026-08-23T07:15:59.800Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 323.968679] nixbot[3473]: {"ts": "2026-08-23T07:15:59.825Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 323.985431] nixbot[3473]: {"ts": "2026-08-23T07:15:59.842Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 323.992263] nixbot[3473]: {"ts": "2026-08-23T07:15:59.846Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 323.999078] nixbot[3473]: {"ts": "2026-08-23T07:15:59.851Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 324.005991] nixbot[3473]: {"ts": "2026-08-23T07:15:59.862Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 324.012546] nixbot[3473]: {"ts": "2026-08-23T07:15:59.869Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 324.019443] nixbot[3473]: {"ts": "2026-08-23T07:15:59.871Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 324.026093] nixbot[3473]: {"ts": "2026-08-23T07:15:59.881Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 324.032720] nixbot[3473]: {"ts": "2026-08-23T07:15:59.883Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 324.042355] nixbot[3473]: {"ts": "2026-08-23T07:15:59.892Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 324.053849] nixbot[3473]: {"ts": "2026-08-23T07:15:59.910Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 324.062150] nixbot[3473]: {"ts": "2026-08-23T07:15:59.919Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 324.069237] nixbot[3473]: {"ts": "2026-08-23T07:15:59.921Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 324.077066] nixbot[3473]: {"ts": "2026-08-23T07:15:59.926Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 324.083604] nixbot[3473]: {"ts": "2026-08-23T07:15:59.927Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 324.089410] nixbot[3473]: {"ts": "2026-08-23T07:15:59.930Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 324.095292] nixbot[3473]: {"ts": "2026-08-23T07:15:59.931Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 324.100596] nixbot[3473]: {"ts": "2026-08-23T07:15:59.936Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 324.105561] nixbot[3473]: {"ts": "2026-08-23T07:15:59.938Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 324.110327] nixbot[3473]: {"ts": "2026-08-23T07:15:59.940Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 324.115549] nixbot[3473]: {"ts": "2026-08-23T07:15:59.945Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 324.122634] nixbot[3473]: {"ts": "2026-08-23T07:15:59.947Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 324.132305] nixbot[3473]: {"ts": "2026-08-23T07:15:59.949Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 324.134854] nixbot[3473]: {"ts": "2026-08-23T07:15:59.950Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 324.542819] nixbot[3473]: INFO: Started server process [3473] gitlab # [ 324.546167] nixbot[3473]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 324.590486] nixbot[3473]: INFO: ::ffff:127.0.0.1:42970 - "GET /health HTTP/1.1" 200 OK gitlab # [ 324.602914] systemd[1]: Started nixbot CI service. gitlab # [ 324.605815] systemd[1]: Reached target Multi-User System. gitlab # [ 324.608843] systemd[1]: Startup finished in 748ms (kernel) + 4.174s (initrd) + 5min 19.685s (userspace) = 5min 24.608s. gitlab: (finished: waiting for unit nixbot.service, in 2.14 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 325.176674] nixbot[3473]: INFO: ::ffff:127.0.0.1:42986 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 325.367445] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 128 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.19 seconds) gitlab # [ 325.784372] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:01 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1194 gitlab # [ 325.788508] nixbot[3473]: {"ts": "2026-08-23T07:16:01.644Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 325.833977] nixbot[3473]: {"ts": "2026-08-23T07:16:01.690Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 325.948594] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 100 gitlab # [ 325.955188] nixbot[3473]: {"ts": "2026-08-23T07:16:01.807Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 325.962434] nixbot[3473]: {"ts": "2026-08-23T07:16:01.811Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 326.146460] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:02 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 187 gitlab # [ 326.149340] nixbot[3473]: {"ts": "2026-08-23T07:16:02.005Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab # [ 326.332571] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:02 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 168 gitlab # [ 326.335542] nixbot[3473]: {"ts": "2026-08-23T07:16:02.191Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 326.411752] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:02 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 62 gitlab # [ 326.418533] nixbot[3473]: {"ts": "2026-08-23T07:16:02.269Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 326.496533] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:02 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 70 gitlab # [ 326.503186] nixbot[3473]: {"ts": "2026-08-23T07:16:02.354Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 326.576297] gitaly[890]: time="2026-08-23T07:16:02.432Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKX5ZP1E8G2H3GA9YK5M7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-23T07:16:32.018" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:16:02.418" grpc.time_ms=13.158 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 326.592749] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:02 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 142 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.22 seconds) (finished: subtest: project discovered and webhook registered, in 1.41 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 326.609826] gitaly[890]: time="2026-08-23T07:16:02.466Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKX5ZP1E8G2H3GA9YK5M7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:16:32.065" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:16:02.465" grpc.time_ms=0.692 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 326.624666] gitaly[890]: time="2026-08-23T07:16:02.481Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=7 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKX5ZP1E8G2H3GA9YK5M7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-23T07:16:12.081" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:16:02.471" grpc.time_ms=9.626 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 326.657613] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:02 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 144 gitlab # [ 326.659987] nixbot[3473]: {"ts": "2026-08-23T07:16:02.512Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 326.735202] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:02 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 58 gitlab # [ 326.800921] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:02 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 139 gitlab # [ 326.809000] nixbot[3473]: {"ts": "2026-08-23T07:16:02.658Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 326.817220] nixbot[3473]: {"ts": "2026-08-23T07:16:02.662Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 326.932778] gitaly[890]: time="2026-08-23T07:16:02.789Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXD11RXQP306F4F98F0V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:02.775" grpc.time_ms=13.8 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # Enumerating objects: 5, done. gitlab # [ 326.968417] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:02 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 196 gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)[ 326.985416] gitaly[890]: time="2026-08-23T07:16:02.842Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXHM9JX9697GTVSNKY0W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:02.829" grpc.time_ms=12.377 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # Writing objects: 100% (3/3), 273 bytes | 68.00 KiB/s, done. gitlab # [ 327.012654] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:02 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 102 gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 327.282841] gitaly[890]: time="2026-08-23T07:16:03.139Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKXN2RE3X3VYJ71G1PQ7T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.118" pid=890 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 327.309182] gitaly[890]: time="2026-08-23T07:16:03.139Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKXN2RE3X3VYJ71G1PQ7T grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.118" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 327.333482] gitlab-workhorse[817]: time="2026-08-23T07:16:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 327.336348] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:03 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 290 gitlab # [ 327.339120] gitaly[890]: time="2026-08-23T07:16:03.140Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKXN2RE3X3VYJ71G1PQ7T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.118" grpc.time_ms=21.736 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 327.407026] gitaly[890]: time="2026-08-23T07:16:03.263Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKXYEZZKJPPEKK27PSHNQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.239" pid=890 remote_ip="2001:db8:1::1" request_sha=a2ee867acb8d1bbb6e09d3141d6aa2cad7d24bda response_bytes=223 span.kind=server system=grpc gitlab # [ 327.440262] gitaly[890]: time="2026-08-23T07:16:03.264Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1135 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=5 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKXYEZZKJPPEKK27PSHNQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.239" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 327.469969] gitlab-workhorse[817]: time="2026-08-23T07:16:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=223 gitlab # [ 327.473643] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:03 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 114 gitlab # [ 327.476912] gitaly[890]: time="2026-08-23T07:16:03.264Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1135 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=5 command.system_time_ms=20 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKXYEZZKJPPEKK27PSHNQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.239" grpc.time_ms=24.867 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 327.498680] gitaly[890]: time="2026-08-23T07:16:03.307Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=300 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-23T07:16:33.092" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-23T07:16:03.292" grpc.time_ms=14.794 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 327.515796] gitaly[890]: time="2026-08-23T07:16:03.337Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ duration_ms=165ns method=POST pid=890 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 327.530840] gitaly[890]: time="2026-08-23T07:16:03.387Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ duration_ms=49ns method=POST pid=890 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 327.535787] gitaly[890]: time="2026-08-23T07:16:03.390Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5313 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:16:03.171" grpc.time_ms=216.75 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 327.568569] gitaly[890]: time="2026-08-23T07:16:03.425Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKY4ZWB51R5E75M6D35BC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=200 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.417" grpc.time_ms=7.786 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 327.590059] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:03 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 66 gitlab # [ 327.595110] gitaly[890]: time="2026-08-23T07:16:03.447Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4783 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:16:03.447" grpc.time_ms=0.647 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 327.630496] gitaly[890]: time="2026-08-23T07:16:03.487Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4782 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:16:03.487" grpc.time_ms=0.412 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 327.642283] gitaly[890]: time="2026-08-23T07:16:03.498Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKY7269THENXXK6G1FY18 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.488" pid=890 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 327.654466] gitlab-workhorse[817]: time="2026-08-23T07:16:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 327.656414] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:03 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 72 gitlab # [ 327.658298] gitaly[890]: time="2026-08-23T07:16:03.498Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKY7269THENXXK6G1FY18 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.488" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 327.672024] gitaly[890]: time="2026-08-23T07:16:03.499Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKY7269THENXXK6G1FY18 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.488" grpc.time_ms=9.442 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 327.686771] gitaly[890]: time="2026-08-23T07:16:03.520Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4784 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:16:03.519" grpc.time_ms=0.928 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 327.717463] gitaly[890]: time="2026-08-23T07:16:03.574Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKY9D8ZXCAKNHCWX22TJT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.552" pid=890 remote_ip="2001:db8:1::1" request_sha=cd12fbe5bdd9e82085a4d10ceb1c6e4ff7ac9843 response_bytes=337 span.kind=server system=grpc gitlab # [ 327.728313] gitaly[890]: time="2026-08-23T07:16:03.574Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1130 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKY9D8ZXCAKNHCWX22TJT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.552" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 327.742760] gitlab-workhorse[817]: time="2026-08-23T07:16:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=337 gitlab # [ 327.744808] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:03 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 337 "" "git/2.55.0" 74 gitlab # [ 327.746799] gitaly[890]: time="2026-08-23T07:16:03.574Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1130 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKY9D8ZXCAKNHCWX22TJT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.552" grpc.time_ms=22.292 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 327.762423] gitaly[890]: time="2026-08-23T07:16:03.618Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ duration_ms=69ns method=POST pid=890 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 327.766225] gitaly[890]: time="2026-08-23T07:16:03.618Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4807 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:16:03.547" grpc.time_ms=70.616 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # To http://gitlab/root/test-flake.git gitlab # [ 327.777302] gitaly[890]: time="2026-08-23T07:16:03.631Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ diskcache=a310e9b2-100c-40a9-ab76-d25a55ada3b7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.059" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # 1f8ec03..fd0c5ec [ 327.787957] gitlab-workhorse[817]: time="2026-08-23T07:16:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # master -> master[ 327.790044] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:03 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 755 gitlab # gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.22 seconds) gitlab # [ 327.792195] gitaly[890]: time="2026-08-23T07:16:03.632Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=213 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13120 command.oublock=32 command.real_time_ms=559 command.spawn_token_fork_ms=2 command.system_time_ms=129 command.user_time_ms=84 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.059" grpc.time_ms=572.578 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 327.877551] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:03 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 56 gitlab # [ 327.880542] gitaly[890]: time="2026-08-23T07:16:03.735Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKYEXD9VJJABTWJ64QCG3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.726" grpc.time_ms=7.418 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 327.918924] nixbot[3473]: INFO: ::ffff:127.0.0.1:42988 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.10 seconds) gitlab # [ 327.965943] gitaly[890]: time="2026-08-23T07:16:03.822Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKYGYAS9RZG6FEVQEKRKG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.805" pid=890 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 327.991892] gitaly[890]: time="2026-08-23T07:16:03.823Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKYGYAS9RZG6FEVQEKRKG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.805" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 328.017421] gitlab-workhorse[817]: time="2026-08-23T07:16:03Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 328.020638] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:03 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 81 gitlab # [ 328.023953] gitaly[890]: time="2026-08-23T07:16:03.823Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKYGYAS9RZG6FEVQEKRKG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:03.805" grpc.time_ms=18.226 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 328.072807] gitaly[890]: time="2026-08-23T07:16:03.929Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:16:33.728" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:16:03.928" grpc.time_ms=0.748 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.130164] gitaly[890]: time="2026-08-23T07:16:03.987Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-23T07:16:33.770" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:16:03.971" grpc.time_ms=15.888 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.163377] gitaly[890]: time="2026-08-23T07:16:04.017Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:16:14.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:16:04.001" grpc.time_ms=15.708 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.186404] gitaly[890]: time="2026-08-23T07:16:04.043Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:16:14.026" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:16:04.026" grpc.time_ms=16.078 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.266700] gitaly[890]: time="2026-08-23T07:16:04.123Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T07:16:14.122" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:16:04.122" grpc.time_ms=0.593 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.301027] gitaly[890]: time="2026-08-23T07:16:04.158Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T07:16:14.140" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:16:04.141" grpc.time_ms=16.326 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.378336] gitaly[890]: time="2026-08-23T07:16:04.235Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:16:04.234" grpc.time_ms=0.563 pid=890 span.kind=server system=grpc gitlab # [ 328.433726] gitaly[890]: time="2026-08-23T07:16:04.290Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:16:04.289" grpc.time_ms=0.854 pid=890 span.kind=server system=grpc gitlab # [ 328.455821] gitaly[890]: time="2026-08-23T07:16:04.303Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV diskcache=6a6202ae-5314-4786-bf4d-6d9015f57c44 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:16:14.177" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:16:04.177" pid=890 ref=refs/keep-around/1f8ec0394350edac657b5f15df8a4781d8db2c85 remote_ip="2001:db8:1::1" revision=1f8ec0394350edac657b5f15df8a4781d8db2c85 span.kind=server system=grpc username=root gitlab # [ 328.476660] gitaly[890]: time="2026-08-23T07:16:04.303Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=126 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5488 command.oublock=8 command.real_time_ms=119 command.spawn_token_fork_ms=1 command.system_time_ms=93 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:16:14.177" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:16:04.177" grpc.time_ms=126.099 pid=890 ref=refs/keep-around/1f8ec0394350edac657b5f15df8a4781d8db2c85 remote_ip="2001:db8:1::1" revision=1f8ec0394350edac657b5f15df8a4781d8db2c85 span.kind=server system=grpc username=root gitlab # [ 328.499489] gitaly[890]: time="2026-08-23T07:16:04.311Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:16:34.109" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:16:04.310" grpc.time_ms=0.736 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 328.801318] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:04 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 788 gitlab # [ 328.807480] nixbot[3473]: {"ts": "2026-08-23T07:16:04.659Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 \"HTTP/1.1 201 Created\""} gitlab # [ 328.818468] nixbot[3473]: {"ts": "2026-08-23T07:16:04.675Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-1f8ec0394350-0"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 328.929858] systemd[1]: Started Nix Daemon. gitlab # [ 328.973536] nixbot[3473]: INFO: ::ffff:127.0.0.1:42994 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab # [ 329.040573] nix-daemon[3690]: accepted connection from pid 3684, user nixbot gitlab # [ 329.172699] nix-daemon[3690]: accepted connection from pid 3700, user nixbot gitlab # [ 329.201271] nixbot[3473]: {"ts": "2026-08-23T07:16:05.058Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-1f8ec0394350-0", "argv0": "bwrap"} gitlab # [ 329.429525] nix-daemon[3690]: accepted connection from pid 3710, user nixbot gitlab # [ 329.524993] nix-daemon[3690]: accepted connection from pid 3720, user nixbot gitlab # [ 329.553280] nix-daemon[3690]: accepted connection from pid 3710, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 330.034445] nixbot[3473]: INFO: ::ffff:127.0.0.1:43002 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 331.089649] nixbot[3473]: INFO: ::ffff:127.0.0.1:52854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 332.143213] nixbot[3473]: INFO: ::ffff:127.0.0.1:52866 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 333.198062] nixbot[3473]: INFO: ::ffff:127.0.0.1:52880 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 334.248308] gitaly[890]: time="2026-08-23T07:16:10.103Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQM4KYMSGKM15WB6Z942CZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:16:40.001" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:16:10.102" grpc.time_ms=1.157 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.09 seconds) gitlab # [ 334.287268] nixbot[3473]: INFO: ::ffff:127.0.0.1:52884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab # [ 334.441770] gitaly[890]: time="2026-08-23T07:16:10.298Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0PQM4KYMSGKM15WB6Z942CZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:16:20.280" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:16:10.280" grpc.time_ms=17.575 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 334.551159] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 424 gitlab # [ 334.559320] nixbot[3473]: {"ts": "2026-08-23T07:16:10.409Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 \"HTTP/1.1 201 Created\""} gitlab # [ 334.666183] gitaly[890]: time="2026-08-23T07:16:10.523Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQM51H393S80G8ABPTH13D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:16:40.120" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:16:10.521" grpc.time_ms=1.161 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 334.897115] gitaly[890]: time="2026-08-23T07:16:10.754Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQM51H393S80G8ABPTH13D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:16:20.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:16:10.736" grpc.time_ms=17.449 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 335.077681] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:10 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 516 gitlab # [ 335.086072] nixbot[3473]: {"ts": "2026-08-23T07:16:10.936Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 \"HTTP/1.1 201 Created\""} gitlab # [ 335.202490] gitaly[890]: time="2026-08-23T07:16:11.059Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQM5J7AQDX4D0JW6P8MGFE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:16:41.057" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:16:11.057" grpc.time_ms=1.238 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 335.277921] gitaly[890]: time="2026-08-23T07:16:11.133Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQM5J7AQDX4D0JW6P8MGFE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:16:21.116" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:16:11.116" grpc.time_ms=17.055 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 335.352348] nixbot[3473]: INFO: ::ffff:127.0.0.1:52896 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.07 seconds) gitlab # [ 335.399182] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:11 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 303 gitlab # [ 335.408742] nixbot[3473]: {"ts": "2026-08-23T07:16:11.257Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 \"HTTP/1.1 201 Created\""} gitlab # [ 335.556921] nix-daemon[3690]: accepted connection from pid 3764, user nixbot gitlab # [ 335.754163] gitaly[890]: time="2026-08-23T07:16:11.611Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQM637DF625T4ACPG79HZX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:11.593" grpc.time_ms=17.291 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 335.783230] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 115 gitlab # [ 336.018664] gitaly[890]: time="2026-08-23T07:16:11.875Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQM66YYN5E6VBC1Z5FCEN3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:11.857" pid=890 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 336.050238] gitaly[890]: time="2026-08-23T07:16:11.875Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQM66YYN5E6VBC1Z5FCEN3 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:11.857" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 336.079481] gitlab-workhorse[817]: time="2026-08-23T07:16:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 336.082819] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:16:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 262 gitlab # [ 336.086064] gitaly[890]: time="2026-08-23T07:16:11.876Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQM66YYN5E6VBC1Z5FCEN3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:16:11.857" grpc.time_ms=18.706 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 336.204813] nix-daemon[3690]: accepted connection from pid 3789, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 336.413518] nixbot[3473]: INFO: ::ffff:127.0.0.1:52908 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 337.466795] nixbot[3473]: INFO: ::ffff:127.0.0.1:52924 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 338.520761] nixbot[3473]: INFO: ::ffff:127.0.0.1:52926 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 339.580808] nixbot[3473]: INFO: ::ffff:127.0.0.1:52938 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 340.634390] nixbot[3473]: INFO: ::ffff:127.0.0.1:52952 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 341.687882] nixbot[3473]: INFO: ::ffff:127.0.0.1:33392 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 342.742241] nixbot[3473]: INFO: ::ffff:127.0.0.1:33406 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 343.797610] nixbot[3473]: INFO: ::ffff:127.0.0.1:33420 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 344.852340] nixbot[3473]: INFO: ::ffff:127.0.0.1:33424 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 345.905666] nixbot[3473]: INFO: ::ffff:127.0.0.1:33426 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 346.959513] nixbot[3473]: INFO: ::ffff:127.0.0.1:33430 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 348.015713] nixbot[3473]: INFO: ::ffff:127.0.0.1:33444 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab # [ 349.072904] nixbot[3473]: INFO: ::ffff:127.0.0.1:33450 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 350.126771] nixbot[3473]: INFO: ::ffff:127.0.0.1:33462 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 351.178586] nixbot[3473]: INFO: ::ffff:127.0.0.1:59904 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 352.232915] nixbot[3473]: INFO: ::ffff:127.0.0.1:59910 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 353.285163] nixbot[3473]: INFO: ::ffff:127.0.0.1:59924 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 354.339857] nixbot[3473]: INFO: ::ffff:127.0.0.1:59926 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 355.392188] nixbot[3473]: INFO: ::ffff:127.0.0.1:59940 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 356.446589] nixbot[3473]: INFO: ::ffff:127.0.0.1:59956 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 357.500909] nixbot[3473]: INFO: ::ffff:127.0.0.1:59964 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 358.554326] nixbot[3473]: INFO: ::ffff:127.0.0.1:59970 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 359.608784] nixbot[3473]: INFO: ::ffff:127.0.0.1:59972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 360.660398] nixbot[3473]: INFO: ::ffff:127.0.0.1:59974 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 361.712311] nixbot[3473]: INFO: ::ffff:127.0.0.1:39308 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab # [ 362.121364] sidekiq-cluster[3417]: 2026-08-23T07:16:37.977Z pid=3417 tid=yr5 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3417, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431751168} gitlab # [ 362.408898] sidekiq-cluster[3417]: W, [2026-08-23T07:16:38.265756 #3417] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 362.471859] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:16:38.328Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 362.764773] nixbot[3473]: INFO: ::ffff:127.0.0.1:39310 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 363.818500] nixbot[3473]: INFO: ::ffff:127.0.0.1:39316 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 364.871164] nixbot[3473]: INFO: ::ffff:127.0.0.1:39324 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 365.927608] nixbot[3473]: INFO: ::ffff:127.0.0.1:39330 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab # [ 365.937621] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:16:41.793Z","message":"GitLab reliable fetch activated!"} gitlab # [ 365.942516] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:16:41.793Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 366.981904] nixbot[3473]: INFO: ::ffff:127.0.0.1:39346 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 368.034595] nixbot[3473]: INFO: ::ffff:127.0.0.1:39350 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 369.088961] nixbot[3473]: INFO: ::ffff:127.0.0.1:39360 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 370.143045] nixbot[3473]: INFO: ::ffff:127.0.0.1:39368 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 371.197761] nixbot[3473]: INFO: ::ffff:127.0.0.1:35658 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 372.252288] nixbot[3473]: INFO: ::ffff:127.0.0.1:35672 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 373.303944] nixbot[3473]: INFO: ::ffff:127.0.0.1:35688 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 374.358327] nixbot[3473]: INFO: ::ffff:127.0.0.1:35690 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 375.418101] nixbot[3473]: INFO: ::ffff:127.0.0.1:35698 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 376.473367] nixbot[3473]: INFO: ::ffff:127.0.0.1:35702 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 377.525340] nixbot[3473]: INFO: ::ffff:127.0.0.1:35710 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 378.579987] nixbot[3473]: INFO: ::ffff:127.0.0.1:35714 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 379.634693] nixbot[3473]: INFO: ::ffff:127.0.0.1:35722 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 380.686746] nixbot[3473]: INFO: ::ffff:127.0.0.1:35736 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 381.740860] nixbot[3473]: INFO: ::ffff:127.0.0.1:38750 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 382.796769] nixbot[3473]: INFO: ::ffff:127.0.0.1:38762 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 383.851580] nixbot[3473]: INFO: ::ffff:127.0.0.1:38772 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab # [ 384.909016] nixbot[3473]: INFO: ::ffff:127.0.0.1:38784 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 385.962966] nixbot[3473]: INFO: ::ffff:127.0.0.1:38800 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 387.015957] nixbot[3473]: INFO: ::ffff:127.0.0.1:38812 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 388.067574] nixbot[3473]: INFO: ::ffff:127.0.0.1:38816 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 389.119988] nixbot[3473]: INFO: ::ffff:127.0.0.1:38826 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 390.174170] nixbot[3473]: INFO: ::ffff:127.0.0.1:38832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 391.228704] nixbot[3473]: INFO: ::ffff:127.0.0.1:59342 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 392.281152] nixbot[3473]: INFO: ::ffff:127.0.0.1:59348 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 393.333945] nixbot[3473]: INFO: ::ffff:127.0.0.1:59356 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 394.388854] nixbot[3473]: INFO: ::ffff:127.0.0.1:59366 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 395.441622] nixbot[3473]: INFO: ::ffff:127.0.0.1:59380 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 396.495651] nixbot[3473]: INFO: ::ffff:127.0.0.1:59386 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 397.550511] nixbot[3473]: INFO: ::ffff:127.0.0.1:59390 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 398.605043] nixbot[3473]: INFO: ::ffff:127.0.0.1:59394 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 399.657454] nixbot[3473]: INFO: ::ffff:127.0.0.1:59410 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 400.709483] nixbot[3473]: INFO: ::ffff:127.0.0.1:59414 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 401.764728] nixbot[3473]: INFO: ::ffff:127.0.0.1:51470 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 402.818178] nixbot[3473]: INFO: ::ffff:127.0.0.1:51486 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab # [ 403.474338] postgres[4009]: [4009] ERROR: relation "table_without_models" does not exist gitlab # [ 403.477935] postgres[4009]: [4009] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 403.872858] nixbot[3473]: INFO: ::ffff:127.0.0.1:51492 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 404.928854] nixbot[3473]: INFO: ::ffff:127.0.0.1:51508 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 405.980209] nixbot[3473]: INFO: ::ffff:127.0.0.1:51524 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab # [ 406.638170] sidekiq-cluster[3417]: InitializerConnections Query: SET client_min_messages TO 'warning' gitlab # [ 406.638555] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 406.638674] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 406.638790] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 406.638901] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 406.639012] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 406.639130] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 406.639250] sidekiq-cluster[3417]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 406.703373] sidekiq-cluster[3417]: InitializerConnections Query: SET standard_conforming_strings = on gitlab # [ 406.707300] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 406.711778] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 406.715684] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 406.719901] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 406.723733] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 406.727535] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 406.732341] sidekiq-cluster[3417]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 406.737149] sidekiq-cluster[3417]: InitializerConnections Query: SET intervalstyle = iso_8601 gitlab # [ 406.740338] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 406.744212] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 406.747442] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 406.750861] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 406.753686] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 406.756288] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 406.759658] sidekiq-cluster[3417]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 406.770187] sidekiq-cluster[3417]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT t.oid, t.typname gitlab # [ 406.774871] sidekiq-cluster[3417]: FROM pg_type as t gitlab # [ 406.776658] sidekiq-cluster[3417]: WHERE t.typname IN ('int2', 'int4', 'int8', 'oid', 'float4', 'float8', 'numeric', 'bool', 'timestamp', 'timestamptz') gitlab # [ 406.781098] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 406.784704] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 406.787774] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 406.791283] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 406.794394] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 406.797409] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 406.801041] sidekiq-cluster[3417]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 406.804564] sidekiq-cluster[3417]: InitializerConnections Query: SET SESSION timezone TO 'UTC' gitlab # [ 406.806926] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 406.809870] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 406.812220] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 406.814706] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 406.816859] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 406.818996] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 406.821732] sidekiq-cluster[3417]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab # [ 406.824386] sidekiq-cluster[3417]: InitializerConnections Query: /*application:sidekiq,db_config_database:gitlab,db_config_name:main*/ SELECT "feature_gates"."key", "feature_gates"."value" FROM "feature_gates" WHERE "feature_gates"."feature_key" = 'sidekiq_throttling_middleware' gitlab # [ 406.829284] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:359:in `block in current_feature_value' gitlab # [ 406.831432] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:374:in `with_feature' gitlab # [ 406.833405] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:355:in `current_feature_value' gitlab # [ 406.835355] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:141:in `enabled?' gitlab # [ 406.837865] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/feature.rb:156:in `disabled?' gitlab # [ 406.839488] sidekiq-cluster[3417]: InitializerConnections Backtrace: lib/gitlab/background_task.rb:60:in `block (2 levels) in start' gitlab # [ 406.841671] sidekiq-cluster[3417]: See https://docs.gitlab.com/ee/development/rails_initializers.html#database-connections-in-initializers gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 407.035090] nixbot[3473]: INFO: ::ffff:127.0.0.1:51534 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 408.086898] nixbot[3473]: INFO: ::ffff:127.0.0.1:51542 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 408.355717] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:24.205Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 408.361791] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:24.213Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 408.367905] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:24.213Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 408.373423] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:24.213Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 408.379482] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:24.215Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 409.142372] nixbot[3473]: INFO: ::ffff:127.0.0.1:51546 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 410.197396] nixbot[3473]: INFO: ::ffff:127.0.0.1:51560 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab # [ 410.973971] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:26.829Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"0c224d096318cbd57f357ec5","created_at":"2026-08-23T07:15:54.812Z","trace_propagation_headers":{"sentry-trace":"b6e4e455d1424ba6aee617f86a0a81c1-0d30248c151a4ab3","baggage":"sentry-trace_id=b6e4e455d1424ba6aee617f86a0a81c1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKKXHJHYMZ4H7RRXFV7W4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:54.882Z","job_size_bytes":2,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-0c224d096318cbd57f357ec5: start","job_status":"start","queue_duration_s":91.945915,"scheduling_latency_s":91.946015} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.05 seconds) gitlab # [ 411.241350] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:27.097Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"0c224d096318cbd57f357ec5","created_at":"2026-08-23T07:15:54.812Z","trace_propagation_headers":{"sentry-trace":"b6e4e455d1424ba6aee617f86a0a81c1-0d30248c151a4ab3","baggage":"sentry-trace_id=b6e4e455d1424ba6aee617f86a0a81c1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKKXHJHYMZ4H7RRXFV7W4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:54.882Z","job_size_bytes":2,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-0c224d096318cbd57f357ec5: done: 0.268867 sec","job_status":"done","queue_duration_s":91.945915,"scheduling_latency_s":91.946015,"redis_calls":23,"redis_duration_s":0.008042,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.004214,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002171,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001657,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.122722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14955622,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.268867,"completed_at":"2026-08-23T07:17:27.097Z","load_balancing_strategy":"primary","db_duration_s":0.09919,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 411.336799] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:27.102Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"bf1d0267e0d2e102e15d9708","created_at":"2026-08-23T07:15:54.918Z","trace_propagation_headers":{"sentry-trace":"b6e4e455d1424ba6aee617f86a0a81c1-0d30248c151a4ab3","baggage":"sentry-trace_id=b6e4e455d1424ba6aee617f86a0a81c1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKKXHJHYMZ4H7RRXFV7W4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:54.933Z","job_size_bytes":2,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-bf1d0267e0d2e102e15d9708: start","job_status":"start","queue_duration_s":92.168874,"scheduling_latency_s":92.168908} gitlab # [ 411.357748] nixbot[3473]: INFO: ::ffff:127.0.0.1:60448 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab # [ 411.408151] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:27.264Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"bf1d0267e0d2e102e15d9708","created_at":"2026-08-23T07:15:54.918Z","trace_propagation_headers":{"sentry-trace":"b6e4e455d1424ba6aee617f86a0a81c1-0d30248c151a4ab3","baggage":"sentry-trace_id=b6e4e455d1424ba6aee617f86a0a81c1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKKXHJHYMZ4H7RRXFV7W4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:54.933Z","job_size_bytes":2,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-bf1d0267e0d2e102e15d9708: done: 0.1623 sec","job_status":"done","queue_duration_s":92.168874,"scheduling_latency_s":92.168908,"redis_calls":14,"redis_duration_s":0.005249,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001524,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002253,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001472,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12530906,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.1623,"completed_at":"2026-08-23T07:17:27.264Z","load_balancing_strategy":"primary","db_duration_s":0.035602,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 411.492082] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:27.266Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2db54efedd1777d4d1a94e60","created_at":"2026-08-23T07:15:55.771Z","trace_propagation_headers":{"sentry-trace":"b6e4e455d1424ba6aee617f86a0a81c1-0d30248c151a4ab3","baggage":"sentry-trace_id=b6e4e455d1424ba6aee617f86a0a81c1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKKXHJHYMZ4H7RRXFV7W4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:55.783Z","job_size_bytes":5,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2db54efedd1777d4d1a94e60: start","job_status":"start","queue_duration_s":91.483434,"scheduling_latency_s":91.48346} gitlab # [ 411.619820] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:27.476Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2db54efedd1777d4d1a94e60","created_at":"2026-08-23T07:15:55.771Z","trace_propagation_headers":{"sentry-trace":"b6e4e455d1424ba6aee617f86a0a81c1-0d30248c151a4ab3","baggage":"sentry-trace_id=b6e4e455d1424ba6aee617f86a0a81c1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKKXHJHYMZ4H7RRXFV7W4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:55.783Z","job_size_bytes":5,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2db54efedd1777d4d1a94e60: done: 0.209501 sec","job_status":"done","queue_duration_s":91.483434,"scheduling_latency_s":91.48346,"redis_calls":12,"redis_duration_s":0.0035960000000000002,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000803,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002229,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.163362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051176,"duration_s":0.209501,"completed_at":"2026-08-23T07:17:27.476Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.039396,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 411.717798] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:27.477Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"aeeaf252652d61773760621e","created_at":"2026-08-23T07:15:55.828Z","trace_propagation_headers":{"sentry-trace":"b6e4e455d1424ba6aee617f86a0a81c1-0d30248c151a4ab3","baggage":"sentry-trace_id=b6e4e455d1424ba6aee617f86a0a81c1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKKXHJHYMZ4H7RRXFV7W4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:55.836Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-aeeaf252652d61773760621e: start","job_status":"start","queue_duration_s":91.641549,"scheduling_latency_s":91.641566} gitlab # [ 411.999451] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:27.854Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"aeeaf252652d61773760621e","created_at":"2026-08-23T07:15:55.828Z","trace_propagation_headers":{"sentry-trace":"b6e4e455d1424ba6aee617f86a0a81c1-0d30248c151a4ab3","baggage":"sentry-trace_id=b6e4e455d1424ba6aee617f86a0a81c1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKKXHJHYMZ4H7RRXFV7W4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:55.836Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-aeeaf252652d61773760621e: done: 0.376695 sec","job_status":"done","queue_duration_s":91.641549,"scheduling_latency_s":91.641566,"redis_calls":11,"redis_duration_s":0.003504,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000655,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000715,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.331,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.331,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.269003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000837,"duration_s":0.376695,"completed_at":"2026-08-23T07:17:27.854Z","load_balancing_strategy":"primary","db_duration_s":0.116123,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 412.098459] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:27.857Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"b18a4611aa75ce78a4e65725","created_at":"2026-08-23T07:15:55.842Z","trace_propagation_headers":{"sentry-trace":"b6e4e455d1424ba6aee617f86a0a81c1-0d30248c151a4ab3","baggage":"sentry-trace_id=b6e4e455d1424ba6aee617f86a0a81c1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKKXHJHYMZ4H7RRXFV7W4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:55.849Z","job_size_bytes":89,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-b18a4611aa75ce78a4e65725: start","job_status":"start","queue_duration_s":92.007748,"scheduling_latency_s":92.007838} gitlab # [ 412.119715] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:27.915Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"b18a4611aa75ce78a4e65725","created_at":"2026-08-23T07:15:55.842Z","trace_propagation_headers":{"sentry-trace":"b6e4e455d1424ba6aee617f86a0a81c1-0d30248c151a4ab3","baggage":"sentry-trace_id=b6e4e455d1424ba6aee617f86a0a81c1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKKXHJHYMZ4H7RRXFV7W4","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-23T07:15:55.849Z","job_size_bytes":89,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-b18a4611aa75ce78a4e65725: done: 0.058661 sec","job_status":"done","queue_duration_s":92.007748,"scheduling_latency_s":92.007838,"redis_calls":11,"redis_duration_s":0.003413,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000887,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001903,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000623,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038178,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057648,"duration_s":0.058661,"completed_at":"2026-08-23T07:17:27.915Z","load_balancing_strategy":"primary","db_duration_s":0.009345,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 412.167691] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:27.918Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 1f8ec0394350edac657b5f15df8a4781d8db2c85 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4b44e7feeddd4c0312583db6","created_at":"2026-08-23T07:15:58.316Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-40d14c08b6ad4211","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:58.354Z","job_size_bytes":185,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4b44e7feeddd4c0312583db6: start","job_status":"start","queue_duration_s":89.564363,"scheduling_latency_s":89.564388} gitlab # [ 412.184696] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:27.942Z","message":"changes: \"0000000000000000000000000000000000000000 1f8ec0394350edac657b5f15df8a4781d8db2c85 refs/heads/master\\n\""} gitlab # [ 412.187319] gitaly[890]: time="2026-08-23T07:17:27.995Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:37.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:27.980" grpc.time_ms=14.72 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.200722] gitaly[890]: time="2026-08-23T07:17:28.012Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:17:38.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:17:28.002" grpc.time_ms=10.383 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 412.232182] gitaly[890]: time="2026-08-23T07:17:28.089Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-23T07:17:38.069" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:28.070" grpc.time_ms=19.036 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab # [ 412.300597] gitaly[890]: time="2026-08-23T07:17:28.157Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3935 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:17:28.156" grpc.time_ms=0.998 pid=890 span.kind=server system=grpc gitlab # [ 412.322748] nixbot[3473]: INFO: ::ffff:127.0.0.1:60456 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab # [ 412.353916] gitaly[890]: time="2026-08-23T07:17:28.210Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:17:28.210" grpc.time_ms=0.69 pid=890 span.kind=server system=grpc gitlab # [ 412.383571] gitaly[890]: time="2026-08-23T07:17:28.223Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF diskcache=c88f0e61-1ac0-4414-9b05-296a90b32d1c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:17:38.102" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:17:28.103" pid=890 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 412.406812] gitaly[890]: time="2026-08-23T07:17:28.224Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=119 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4885 command.oublock=8 command.real_time_ms=114 command.spawn_token_fork_ms=0 command.system_time_ms=48 command.user_time_ms=71 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:17:38.102" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:17:28.103" grpc.time_ms=120.908 pid=890 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 412.429191] gitaly[890]: time="2026-08-23T07:17:28.252Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-23T07:17:38.251" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:17:28.251" grpc.time_ms=0.28 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.443487] gitaly[890]: time="2026-08-23T07:17:28.285Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=861 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-23T07:17:38.259" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:28.260" grpc.time_ms=24.829 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.600517] gitaly[890]: time="2026-08-23T07:17:28.457Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-23T07:17:58.045" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:28.445" grpc.time_ms=11.691 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.664930] gitaly[890]: time="2026-08-23T07:17:28.521Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T07:17:38.010" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:17:28.521" grpc.time_ms=0.572 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.694595] gitaly[890]: time="2026-08-23T07:17:28.537Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=315 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-23T07:17:38.015" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-23T07:17:28.526" grpc.time_ms=11.272 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.726593] gitaly[890]: time="2026-08-23T07:17:28.583Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:38.055" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:28.566" grpc.time_ms=16.953 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.755408] gitaly[890]: time="2026-08-23T07:17:28.612Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:38.084" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:28.594" grpc.time_ms=17.306 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 412.806109] gitaly[890]: time="2026-08-23T07:17:28.663Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T07:17:58.235" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:28.635" grpc.time_ms=27.047 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.04 seconds) gitlab # [ 413.357161] nixbot[3473]: INFO: ::ffff:127.0.0.1:60464 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab # [ 413.447364] gitaly[890]: time="2026-08-23T07:17:29.303Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-23T07:17:39.000" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:29.301" grpc.time_ms=2.069 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.485694] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:29.337Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 1f8ec0394350edac657b5f15df8a4781d8db2c85 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"4b44e7feeddd4c0312583db6","created_at":"2026-08-23T07:15:58.316Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-40d14c08b6ad4211","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:15:58.354Z","job_size_bytes":185,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-4b44e7feeddd4c0312583db6: done: 1.419326 sec","job_status":"done","queue_duration_s":89.564363,"scheduling_latency_s":89.564388,"gitaly_calls":13,"gitaly_duration_s":0.33298,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.060204,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.005413,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.008424,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002009,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006136,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.025273,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.012949,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.087,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.34,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.387,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.087,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.943395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00080942,"exclusive_lock_hold_duration_s":0.039099840000000004,"duration_s":1.419326,"completed_at":"2026-08-23T07:17:29.337Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.151074,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 413.573504] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:29.339Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","1f8ec0394350edac657b5f15df8a4781d8db2c85 fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"78c297535dc89b6ca50a291e","created_at":"2026-08-23T07:16:03.589Z","trace_propagation_headers":{"sentry-trace":"8c63ceef6fc44fb6a524a5a4c2537ec1-c6e86a5354b04199","baggage":"sentry-trace_id=8c63ceef6fc44fb6a524a5a4c2537ec1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKXNX6YHTPY4EVZHRNQKJ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:16:03.592Z","job_size_bytes":185,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-78c297535dc89b6ca50a291e: start","job_status":"start","queue_duration_s":85.746453,"scheduling_latency_s":85.746473} gitlab # [ 413.591780] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:29.352Z","message":"changes: \"1f8ec0394350edac657b5f15df8a4781d8db2c85 fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe refs/heads/master\\n\""} gitlab # [ 413.595180] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:29.415Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d39d89e45383f91cbd99e41a","created_at":"2026-08-23T07:17:29.413Z","trace_propagation_headers":{"sentry-trace":"8c63ceef6fc44fb6a524a5a4c2537ec1-49525effaeb8436f","baggage":"sentry-trace_id=8c63ceef6fc44fb6a524a5a4c2537ec1,sentry-release=Unknown"},"correlation_id":"01M0PQKXNX6YHTPY4EVZHRNQKJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"ac243c1fc98a3979e83ac4cf","job_size_bytes":46,"pid":3417,"job_status":"deduplicated","message":"ProjectCacheWorker JID-d39d89e45383f91cbd99e41a: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 413.610245] gitaly[890]: time="2026-08-23T07:17:29.387Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:39.070" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:29.370" grpc.time_ms=16.426 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.623678] gitaly[890]: time="2026-08-23T07:17:29.411Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-23T07:17:39.095" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:17:29.395" grpc.time_ms=14.97 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.637193] gitaly[890]: time="2026-08-23T07:17:29.447Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-23T07:17:39.131" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:29.431" grpc.time_ms=16.272 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.650801] gitaly[890]: time="2026-08-23T07:17:29.472Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-23T07:17:59.052" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:29.453" grpc.time_ms=18.466 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.666219] gitaly[890]: time="2026-08-23T07:17:29.501Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-23T07:17:39.191" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-23T07:17:29.492" grpc.time_ms=8.902 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.679537] gitaly[890]: time="2026-08-23T07:17:29.532Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:39.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:29.515" grpc.time_ms=16.903 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 413.983109] gitaly[890]: time="2026-08-23T07:17:29.840Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-23T07:17:39.183" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:29.694" grpc.time_ms=145.524 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.030106] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:29.885Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","1f8ec0394350edac657b5f15df8a4781d8db2c85 fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"78c297535dc89b6ca50a291e","created_at":"2026-08-23T07:16:03.589Z","trace_propagation_headers":{"sentry-trace":"8c63ceef6fc44fb6a524a5a4c2537ec1-c6e86a5354b04199","baggage":"sentry-trace_id=8c63ceef6fc44fb6a524a5a4c2537ec1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKXNX6YHTPY4EVZHRNQKJ","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-23T07:16:03.592Z","job_size_bytes":185,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-78c297535dc89b6ca50a291e: done: 0.546349 sec","job_status":"done","queue_duration_s":85.746453,"scheduling_latency_s":85.746473,"gitaly_calls":7,"gitaly_duration_s":0.262066,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.03072,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.003622,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001419,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.004596,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.00895,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.012133,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.038,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.038,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.380664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00078822,"exclusive_lock_hold_duration_s":0.02709896,"duration_s":0.546349,"completed_at":"2026-08-23T07:17:29.885Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042102,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 414.106951] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:29.889Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"998a779c785e212e403dc829","created_at":"2026-08-23T07:16:04.320Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-d562e74d6d5f43b0","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-23T07:16:04.346Z","job_size_bytes":65,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-998a779c785e212e403dc829: start","job_status":"start","queue_duration_s":85.542521,"scheduling_latency_s":85.542567} gitlab # [ 414.200577] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:30.056Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"998a779c785e212e403dc829","created_at":"2026-08-23T07:16:04.320Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-d562e74d6d5f43b0","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-23T07:16:04.346Z","job_size_bytes":65,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-998a779c785e212e403dc829: done: 0.167543 sec","job_status":"done","queue_duration_s":85.542521,"scheduling_latency_s":85.542567,"redis_calls":16,"redis_duration_s":0.006265000000000001,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003207,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002285,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000773,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.117127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00075496,"duration_s":0.167543,"completed_at":"2026-08-23T07:17:30.056Z","load_balancing_strategy":"primary","db_duration_s":0.037472,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 414.267193] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:30.060Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2ff79b8e972f822da7886403","created_at":"2026-08-23T07:16:04.348Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-d562e74d6d5f43b0","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-23T07:16:04.362Z","job_size_bytes":65,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2ff79b8e972f822da7886403: start","job_status":"start","queue_duration_s":85.698026,"scheduling_latency_s":85.698057} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.07 seconds) gitlab # [ 414.404685] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:30.260Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"2ff79b8e972f822da7886403","created_at":"2026-08-23T07:16:04.348Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-d562e74d6d5f43b0","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-23T07:16:04.362Z","job_size_bytes":65,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-2ff79b8e972f822da7886403: done: 0.20016 sec","job_status":"done","queue_duration_s":85.698026,"scheduling_latency_s":85.698057,"redis_calls":21,"redis_duration_s":0.007685,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.00292,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002589,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002176,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.033,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.128284,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00101678,"duration_s":0.20016,"completed_at":"2026-08-23T07:17:30.260Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054433,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 414.515139] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:30.263Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a517917cf1351befd6ca9439","created_at":"2026-08-23T07:16:04.603Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-d562e74d6d5f43b0","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:16:04.617Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a517917cf1351befd6ca9439: start","job_status":"start","queue_duration_s":85.646295,"scheduling_latency_s":85.646334} gitlab # [ 414.564913] nixbot[3473]: INFO: ::ffff:127.0.0.1:60476 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab # [ 414.731729] gitaly[890]: time="2026-08-23T07:17:30.587Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:17:30.586" grpc.time_ms=0.847 pid=890 span.kind=server system=grpc gitlab # [ 414.789494] gitaly[890]: time="2026-08-23T07:17:30.646Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:17:30.645" grpc.time_ms=1.105 pid=890 span.kind=server system=grpc gitlab # [ 414.845669] gitaly[890]: time="2026-08-23T07:17:30.702Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:17:30.700" grpc.time_ms=1.692 pid=890 span.kind=server system=grpc gitlab # [ 414.874304] gitaly[890]: time="2026-08-23T07:17:30.717Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV diskcache=3ad0f285-d8e6-43b6-b113-a8a4abb2b2a7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:18:00.129" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:30.530" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 414.898528] gitaly[890]: time="2026-08-23T07:17:30.718Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=201 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7325 command.oublock=0 command.real_time_ms=180 command.spawn_token_fork_ms=1 command.system_time_ms=110 command.user_time_ms=91 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:18:00.129" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:30.530" grpc.time_ms=187.459 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.067106] gitaly[890]: time="2026-08-23T07:17:30.924Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:18:00.522" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:30.922" grpc.time_ms=1.522 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.152624] gitaly[890]: time="2026-08-23T07:17:31.009Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKYMWMEQN56Q7X5X8A2TV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:01.007" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:31.007" grpc.time_ms=1.318 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.192653] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:31.047Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"a517917cf1351befd6ca9439","created_at":"2026-08-23T07:16:04.603Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-d562e74d6d5f43b0","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:16:04.617Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-a517917cf1351befd6ca9439: done: 0.784072 sec","job_status":"done","queue_duration_s":85.646295,"scheduling_latency_s":85.646334,"gitaly_calls":3,"gitaly_duration_s":0.202346,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.043026,"redis_read_bytes":457,"redis_write_bytes":27999,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002001,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002555,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.015309,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.006669,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14493,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.00876,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001077,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001362,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003292,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.1,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.041,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.047,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.052,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.452902,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.66408258,"duration_s":0.784072,"completed_at":"2026-08-23T07:17:31.047Z","load_balancing_strategy":"primary","db_duration_s":0.118115,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 415.281008] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:31.051Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ac243c1fc98a3979e83ac4cf","created_at":"2026-08-23T07:17:28.016Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-0e643bb5f6bd4b8a","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:28.036Z","job_size_bytes":46,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ac243c1fc98a3979e83ac4cf: start","job_status":"start","queue_duration_s":3.014594,"scheduling_latency_s":3.014623} gitlab # [ 415.298691] gitaly[890]: time="2026-08-23T07:17:31.141Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-23T13:17:31.130" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:17:31.130" grpc.time_ms=10.03 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.315815] gitaly[890]: time="2026-08-23T07:17:31.172Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-23T07:18:01.154" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:31.155" grpc.time_ms=17.244 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 415.361305] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:31.217Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"ac243c1fc98a3979e83ac4cf","created_at":"2026-08-23T07:17:28.016Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-0e643bb5f6bd4b8a","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:28.036Z","job_size_bytes":46,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ac243c1fc98a3979e83ac4cf: done: 0.166221 sec","job_status":"done","queue_duration_s":3.014594,"scheduling_latency_s":3.014623,"gitaly_calls":2,"gitaly_duration_s":0.03396,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011545,"redis_read_bytes":69,"redis_write_bytes":4886,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002154,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000921,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2114,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002329,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004983,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001158,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101047,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045204,"duration_s":0.166221,"completed_at":"2026-08-23T07:17:31.217Z","load_balancing_strategy":"primary","db_duration_s":0.019045,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 415.448566] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:31.219Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"da014696040e2dc5e79926b7","created_at":"2026-08-23T07:17:28.059Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-0e643bb5f6bd4b8a","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:28.065Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-da014696040e2dc5e79926b7: start","job_status":"start","queue_duration_s":3.15466,"scheduling_latency_s":3.154682} gitlab # [ 415.471660] gitaly[890]: time="2026-08-23T07:17:31.286Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF diskcache=55acb6f5-5a7d-4b96-b299-0e52eace0c7b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T13:17:31.252" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:31.253" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab # [ 415.485224] gitaly[890]: time="2026-08-23T07:17:31.287Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1173 command.oublock=0 command.real_time_ms=38 command.spawn_token_fork_ms=3 command.system_time_ms=19 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T13:17:31.252" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:31.253" grpc.time_ms=33.29 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.504038] nixbot[3473]: INFO: ::ffff:127.0.0.1:60482 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab # [ 415.507188] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:31.351Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"da014696040e2dc5e79926b7","created_at":"2026-08-23T07:17:28.059Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-0e643bb5f6bd4b8a","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:28.065Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-da014696040e2dc5e79926b7: done: 0.132047 sec","job_status":"done","queue_duration_s":3.15466,"scheduling_latency_s":3.154682,"gitaly_calls":1,"gitaly_duration_s":0.036589,"redis_calls":15,"redis_duration_s":0.006144,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000619,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002644,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00094,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001941,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.018,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.034,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.060024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0964965,"duration_s":0.132047,"completed_at":"2026-08-23T07:17:31.351Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 415.557338] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:31.354Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"693cdc9076c952a1df65e758","created_at":"2026-08-23T07:17:28.243Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-0e643bb5f6bd4b8a","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:28.247Z","job_size_bytes":23,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-693cdc9076c952a1df65e758: start","job_status":"start","queue_duration_s":3.107262,"scheduling_latency_s":3.107287} gitlab # [ 415.572878] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:31.420Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"693cdc9076c952a1df65e758","created_at":"2026-08-23T07:17:28.243Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-0e643bb5f6bd4b8a","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:28.247Z","job_size_bytes":23,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-693cdc9076c952a1df65e758: done: 0.06574 sec","job_status":"done","queue_duration_s":3.107262,"scheduling_latency_s":3.107287,"gitaly_calls":1,"gitaly_duration_s":0.020022,"redis_calls":16,"redis_duration_s":0.004886,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000388,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001432,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.001946,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00112,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.06574,"completed_at":"2026-08-23T07:17:31.420Z","load_balancing_strategy":"primary","db_duration_s":0.004598,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 415.618100] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:31.422Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"e8799aa21bf250edbc5449b4","created_at":"2026-08-23T07:17:29.077Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-0e643bb5f6bd4b8a","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:715e9dc3244b098989b75fb277200d16390d1228f3bfa00e0befb58ff20637ad","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:29.084Z","job_size_bytes":467,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-e8799aa21bf250edbc5449b4: start","job_status":"start","queue_duration_s":2.338112,"scheduling_latency_s":2.338133} gitlab # [ 415.635452] gitaly[890]: time="2026-08-23T07:17:31.408Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-23T07:18:01.390" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:31.391" grpc.time_ms=17.374 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.648977] gitaly[890]: time="2026-08-23T07:17:31.454Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:01.452" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:31.453" grpc.time_ms=0.851 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.661065] gitaly[890]: time="2026-08-23T07:17:31.473Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T07:17:41.156" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:31.456" grpc.time_ms=16.036 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.835097] gitaly[890]: time="2026-08-23T07:17:31.691Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:18:01.689" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:31.689" grpc.time_ms=1.28 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 415.872959] gitaly[890]: time="2026-08-23T07:17:31.703Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=203 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-23T07:18:01.695" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:31.695" grpc.time_ms=7.392 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.035389] gitaly[890]: time="2026-08-23T07:17:31.892Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:41.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:31.875" grpc.time_ms=17.078 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 416.545487] nixbot[3473]: INFO: ::ffff:127.0.0.1:60486 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.06 seconds) gitlab # [ 416.640828] gitaly[890]: time="2026-08-23T07:17:32.497Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T07:18:02.483" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:32.484" grpc.time_ms=13.137 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.672512] gitaly[890]: time="2026-08-23T07:17:32.529Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKRCXE5NV23BGGFG5PKYF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-23T07:18:02.503" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:32.503" grpc.time_ms=25.718 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 416.736714] sidekiq-cluster[3417]: {"severity":"WARN","time":"2026-08-23T07:17:32.592Z","class":"CreatePipelineWorker","correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"1f8ec0394350edac657b5f15df8a4781d8db2c85","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"1f8ec0394350edac657b5f15df8a4781d8db2c85","ref":"refs/heads/master"},"retry":0} gitlab # [ 416.754529] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:32.610Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"e8799aa21bf250edbc5449b4","created_at":"2026-08-23T07:17:29.077Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-0e643bb5f6bd4b8a","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:715e9dc3244b098989b75fb277200d16390d1228f3bfa00e0befb58ff20637ad","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:29.084Z","job_size_bytes":467,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-e8799aa21bf250edbc5449b4: done: 1.18809 sec","job_status":"done","queue_duration_s":2.338112,"scheduling_latency_s":2.338133,"gitaly_calls":7,"gitaly_duration_s":0.106003,"redis_calls":51,"redis_duration_s":0.015161,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.00137,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006126,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002246,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003766,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001653,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.004164,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00097638,"duration_s":1.18809,"completed_at":"2026-08-23T07:17:32.610Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.086376,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 416.828795] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:32.613Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"69688e5c-32dc-4b69-8a9d-7470f04615cd\"}"],"class":"WebHookWorker","jid":"08a5c533a6a3dbb430a6021b","created_at":"2026-08-23T07:17:29.263Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-0e643bb5f6bd4b8a","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:35ce6e01135784838422ba4a6db6d51689aa3d45220f72d3c3192da62098b905","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:29.270Z","job_size_bytes":1751,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-08a5c533a6a3dbb430a6021b: start","job_status":"start","queue_duration_s":3.343589,"scheduling_latency_s":3.343624} gitlab # [ 417.006154] nixbot[3473]: INFO: ::ffff:127.0.0.1:60494 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 417.048613] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:32.904Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"69688e5c-32dc-4b69-8a9d-7470f04615cd\"}"],"class":"WebHookWorker","jid":"08a5c533a6a3dbb430a6021b","created_at":"2026-08-23T07:17:29.263Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-0e643bb5f6bd4b8a","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:35ce6e01135784838422ba4a6db6d51689aa3d45220f72d3c3192da62098b905","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:29.270Z","job_size_bytes":1751,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-08a5c533a6a3dbb430a6021b: done: 0.29062 sec","job_status":"done","queue_duration_s":3.343589,"scheduling_latency_s":3.343624,"redis_calls":19,"redis_duration_s":0.007176,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001848,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000775,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002876,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001677,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.09088581999998269,"cpu_s":0.17415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000725,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.29062,"completed_at":"2026-08-23T07:17:32.904Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00553,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 417.169452] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:32.907Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a4fdccd408baaf3cd26032dd","created_at":"2026-08-23T07:17:29.423Z","trace_propagation_headers":{"sentry-trace":"8c63ceef6fc44fb6a524a5a4c2537ec1-49525effaeb8436f","baggage":"sentry-trace_id=8c63ceef6fc44fb6a524a5a4c2537ec1,sentry-release=Unknown"},"correlation_id":"01M0PQKXNX6YHTPY4EVZHRNQKJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"da014696040e2dc5e79926b7","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:29.426Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a4fdccd408baaf3cd26032dd: start","job_status":"start","queue_duration_s":3.481531,"scheduling_latency_s":3.481571} gitlab # [ 417.194746] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:33.009Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"a4fdccd408baaf3cd26032dd","created_at":"2026-08-23T07:17:29.423Z","trace_propagation_headers":{"sentry-trace":"8c63ceef6fc44fb6a524a5a4c2537ec1-49525effaeb8436f","baggage":"sentry-trace_id=8c63ceef6fc44fb6a524a5a4c2537ec1,sentry-release=Unknown"},"correlation_id":"01M0PQKXNX6YHTPY4EVZHRNQKJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"da014696040e2dc5e79926b7","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:29.426Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-a4fdccd408baaf3cd26032dd: done: 0.10178 sec","job_status":"done","queue_duration_s":3.481531,"scheduling_latency_s":3.481571,"gitaly_calls":1,"gitaly_duration_s":0.029971,"redis_calls":12,"redis_duration_s":0.004841,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001955,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001125,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001761,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.013,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06166662,"duration_s":0.10178,"completed_at":"2026-08-23T07:17:33.009Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010238,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 417.249986] gitaly[890]: time="2026-08-23T07:17:32.958Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ diskcache=9319d7cb-a0ef-4f50-b10c-18f18fa9a748 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T13:17:32.945" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:32.946" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.259992] gitaly[890]: time="2026-08-23T07:17:32.958Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-23T13:17:32.945" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:32.946" grpc.time_ms=12.304 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.273013] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:33.012Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d179f028ba07139e5c62985d","created_at":"2026-08-23T07:17:29.621Z","trace_propagation_headers":{"sentry-trace":"8c63ceef6fc44fb6a524a5a4c2537ec1-49525effaeb8436f","baggage":"sentry-trace_id=8c63ceef6fc44fb6a524a5a4c2537ec1,sentry-release=Unknown"},"correlation_id":"01M0PQKXNX6YHTPY4EVZHRNQKJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:500e7224869c2cf4617b3b62acfd64279d5aee0ab7e1ee546a10613602c60993","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:29.627Z","job_size_bytes":467,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d179f028ba07139e5c62985d: start","job_status":"start","queue_duration_s":3.385401,"scheduling_latency_s":3.385434} gitlab # [ 417.290535] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:33 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 212 gitlab # [ 417.292678] gitaly[890]: time="2026-08-23T07:17:33.055Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:03.053" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:33.054" grpc.time_ms=1.106 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.305028] gitaly[890]: time="2026-08-23T07:17:33.073Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T07:17:43.009" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:33.059" grpc.time_ms=13.939 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.317710] gitaly[890]: time="2026-08-23T07:17:33.124Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPNKGKFGRKJ85VYTSP0V0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:33.106" grpc.time_ms=17.97 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 417.330990] gitaly[890]: time="2026-08-23T07:17:33.139Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:18:03.138" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:33.138" grpc.time_ms=0.886 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.343863] gitaly[890]: time="2026-08-23T07:17:33.150Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=175 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-23T07:18:03.144" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:33.145" grpc.time_ms=5.557 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.360162] gitaly[890]: time="2026-08-23T07:17:33.205Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:43.142" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:33.192" grpc.time_ms=12.579 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.388746] gitaly[890]: time="2026-08-23T07:17:33.245Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPNT77JSRC24EH56NVZZ7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:33.229" pid=890 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 417.399132] gitaly[890]: time="2026-08-23T07:17:33.245Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPNT77JSRC24EH56NVZZ7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:33.229" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 417.412832] gitlab-workhorse[817]: time="2026-08-23T07:17:33Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 417.414642] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:33 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 126 gitlab # [ 417.416559] gitaly[890]: time="2026-08-23T07:17:33.253Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPNT77JSRC24EH56NVZZ7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:33.229" grpc.time_ms=16.681 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 417.450828] nixbot[3473]: {"ts": "2026-08-23T07:17:33.307Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 417.615272] nixbot[3473]: INFO: ::ffff:127.0.0.1:60506 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.08 seconds) gitlab # [ 417.730632] gitaly[890]: time="2026-08-23T07:17:33.587Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPP0AJYPTTMW6VKMFPVEY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:03.485" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:33.585" grpc.time_ms=1.139 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.830383] gitaly[890]: time="2026-08-23T07:17:33.687Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPP0AJYPTTMW6VKMFPVEY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:43.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:33.669" grpc.time_ms=17.246 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 417.903514] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 437 gitlab # [ 417.906363] nixbot[3473]: {"ts": "2026-08-23T07:17:33.762Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 \"HTTP/1.1 201 Created\""} gitlab # [ 417.975865] gitaly[890]: time="2026-08-23T07:17:33.832Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPPEBSYEG8NGZXN2AFAPQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:03.731" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:33.831" grpc.time_ms=0.898 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.050824] gitaly[890]: time="2026-08-23T07:17:33.907Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=11 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-23T07:18:03.879" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:33.879" grpc.time_ms=27.993 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.066625] gitaly[890]: time="2026-08-23T07:17:33.909Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPPEBSYEG8NGZXN2AFAPQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:43.239" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:33.899" grpc.time_ms=9.398 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.080452] gitaly[890]: time="2026-08-23T07:17:33.936Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQKXNX6YHTPY4EVZHRNQKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-23T07:18:03.012" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:33.912" grpc.time_ms=24.171 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.103924] sidekiq-cluster[3417]: {"severity":"WARN","time":"2026-08-23T07:17:33.960Z","class":"CreatePipelineWorker","correlation_id":"01M0PQKXNX6YHTPY4EVZHRNQKJ","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"1f8ec0394350edac657b5f15df8a4781d8db2c85","after":"fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe","ref":"refs/heads/master"},"retry":0} gitlab # [ 418.114802] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:33.970Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d179f028ba07139e5c62985d","created_at":"2026-08-23T07:17:29.621Z","trace_propagation_headers":{"sentry-trace":"8c63ceef6fc44fb6a524a5a4c2537ec1-49525effaeb8436f","baggage":"sentry-trace_id=8c63ceef6fc44fb6a524a5a4c2537ec1,sentry-release=Unknown"},"correlation_id":"01M0PQKXNX6YHTPY4EVZHRNQKJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:500e7224869c2cf4617b3b62acfd64279d5aee0ab7e1ee546a10613602c60993","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:29.627Z","job_size_bytes":467,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d179f028ba07139e5c62985d: done: 0.9583 sec","job_status":"done","queue_duration_s":3.385401,"scheduling_latency_s":3.385434,"gitaly_calls":7,"gitaly_duration_s":0.112677,"redis_calls":33,"redis_duration_s":0.008407,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000932,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004466,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001328,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.037,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.811392,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.9583,"completed_at":"2026-08-23T07:17:33.970Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036632,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 418.163201] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:33.974Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"98d532ad-5e86-4f6a-b76e-2ce2802c6df2\"}"],"class":"WebHookWorker","jid":"61eff7ab0434a144cad43cd0","created_at":"2026-08-23T07:17:29.660Z","trace_propagation_headers":{"sentry-trace":"8c63ceef6fc44fb6a524a5a4c2537ec1-49525effaeb8436f","baggage":"sentry-trace_id=8c63ceef6fc44fb6a524a5a4c2537ec1,sentry-release=Unknown"},"correlation_id":"01M0PQKXNX6YHTPY4EVZHRNQKJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:12783f6b234a14be240388f84fab5fbefc985818a1d4be4f5787b1d95a58a772","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:29.666Z","job_size_bytes":1749,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-61eff7ab0434a144cad43cd0: start","job_status":"start","queue_duration_s":4.308323,"scheduling_latency_s":4.308361} gitlab # [ 418.181411] nixbot[3473]: {"ts": "2026-08-23T07:17:34.018Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 \"HTTP/1.1 201 Created\""} gitlab # [ 418.184159] nixbot[3473]: INFO: ::ffff:127.0.0.1:60520 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 418.186643] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 244 gitlab # [ 418.204500] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.060Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"98d532ad-5e86-4f6a-b76e-2ce2802c6df2\"}"],"class":"WebHookWorker","jid":"61eff7ab0434a144cad43cd0","created_at":"2026-08-23T07:17:29.660Z","trace_propagation_headers":{"sentry-trace":"8c63ceef6fc44fb6a524a5a4c2537ec1-49525effaeb8436f","baggage":"sentry-trace_id=8c63ceef6fc44fb6a524a5a4c2537ec1,sentry-release=Unknown"},"correlation_id":"01M0PQKXNX6YHTPY4EVZHRNQKJ","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:12783f6b234a14be240388f84fab5fbefc985818a1d4be4f5787b1d95a58a772","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:29.666Z","job_size_bytes":1749,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-61eff7ab0434a144cad43cd0: done: 0.086038 sec","job_status":"done","queue_duration_s":4.308323,"scheduling_latency_s":4.308361,"redis_calls":14,"redis_duration_s":0.004515,"redis_read_bytes":26,"redis_write_bytes":4684,"redis_queues_calls":2,"redis_queues_duration_s":0.000584,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3728,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002365,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001566,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.02213920000002645,"cpu_s":0.047208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.086038,"completed_at":"2026-08-23T07:17:34.060Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003751,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.252473] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.063Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"df2ab8c471fbcfad832c9b30","created_at":"2026-08-23T07:17:30.501Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.510Z","job_size_bytes":23,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-df2ab8c471fbcfad832c9b30: start","job_status":"start","queue_duration_s":3.552766,"scheduling_latency_s":3.552804} gitlab # [ 418.270124] gitaly[890]: time="2026-08-23T07:17:34.121Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPPPEVMKD2ZDP3EKDXR86 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:04.018" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:34.119" grpc.time_ms=2.005 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.310303] gitaly[890]: time="2026-08-23T07:17:34.167Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPPR0N65CYBZF8BQ017VV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:34.159" grpc.time_ms=7.295 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 418.324575] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:34 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 87 gitlab # [ 418.336079] gitaly[890]: time="2026-08-23T07:17:34.193Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPPPEVMKD2ZDP3EKDXR86 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:44.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:34.186" grpc.time_ms=6.88 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 418.350208] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.201Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"df2ab8c471fbcfad832c9b30","created_at":"2026-08-23T07:17:30.501Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.510Z","job_size_bytes":23,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-df2ab8c471fbcfad832c9b30: done: 0.138467 sec","job_status":"done","queue_duration_s":3.552766,"scheduling_latency_s":3.552804,"redis_calls":10,"redis_duration_s":0.005139,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001379,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003189,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000571,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.096479,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048574,"duration_s":0.138467,"completed_at":"2026-08-23T07:17:34.201Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030788,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 418.396532] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.204Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"442a262e3233ce929f93662c","created_at":"2026-08-23T07:17:30.727Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.740Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-442a262e3233ce929f93662c: start","job_status":"start","queue_duration_s":3.464152,"scheduling_latency_s":3.464171} gitlab # [ 418.413618] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.245Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"442a262e3233ce929f93662c","created_at":"2026-08-23T07:17:30.727Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.740Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-442a262e3233ce929f93662c: done: 0.040799 sec","job_status":"done","queue_duration_s":3.464152,"scheduling_latency_s":3.464171,"redis_calls":10,"redis_duration_s":0.004906,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000604,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003213,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035202,"duration_s":0.040799,"completed_at":"2026-08-23T07:17:34.245Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004492,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.458637] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.250Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"3dca73aa2f6af4604bcebd7f","created_at":"2026-08-23T07:17:30.767Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.779Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-3dca73aa2f6af4604bcebd7f: start","job_status":"start","queue_duration_s":3.471331,"scheduling_latency_s":3.471354} gitlab # [ 418.474990] nixbot[3473]: {"ts": "2026-08-23T07:17:34.252Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 \"HTTP/1.1 201 Created\""} gitlab # [ 418.477914] gitaly[890]: time="2026-08-23T07:17:34.242Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPPTTV4SEGG0ZBQVMXWFB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:34.233" pid=890 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 418.489011] gitlab-workhorse[817]: time="2026-08-23T07:17:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 418.490883] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 73 gitlab # [ 418.494810] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:34 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/1f8ec0394350edac657b5f15df8a4781d8db2c85 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 220 gitlab # [ 418.497537] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.297Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"3dca73aa2f6af4604bcebd7f","created_at":"2026-08-23T07:17:30.767Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.779Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-3dca73aa2f6af4604bcebd7f: done: 0.047289 sec","job_status":"done","queue_duration_s":3.471331,"scheduling_latency_s":3.471354,"redis_calls":10,"redis_duration_s":0.001592,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000354,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035852,"duration_s":0.047289,"completed_at":"2026-08-23T07:17:34.297Z","load_balancing_strategy":"primary","db_duration_s":0.005964,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.541249] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.306Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"5f8be47dd0bf4fd14d2f93c7","created_at":"2026-08-23T07:17:30.809Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.820Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5f8be47dd0bf4fd14d2f93c7: start","job_status":"start","queue_duration_s":3.486377,"scheduling_latency_s":3.486399} gitlab # [ 418.557482] nix-daemon[3690]: accepted connection from pid 4254, user nixbot gitlab # [ 418.558628] gitaly[890]: time="2026-08-23T07:17:34.242Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPPTTV4SEGG0ZBQVMXWFB grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:34.233" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 418.572396] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:34 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 61 gitlab # [ 418.574427] gitlab-workhorse[817]: time="2026-08-23T07:17:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 418.576310] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 71 gitlab # [ 418.578171] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.352Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"5f8be47dd0bf4fd14d2f93c7","created_at":"2026-08-23T07:17:30.809Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.820Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-5f8be47dd0bf4fd14d2f93c7: done: 0.045485 sec","job_status":"done","queue_duration_s":3.486377,"scheduling_latency_s":3.486399,"redis_calls":13,"redis_duration_s":0.003323,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000481,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000348,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000693,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029184,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025938,"duration_s":0.045485,"completed_at":"2026-08-23T07:17:34.352Z","load_balancing_strategy":"primary","db_duration_s":0.006267,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 418.624845] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.357Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7ed157b7ea468157e661e189","created_at":"2026-08-23T07:17:30.821Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.830Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7ed157b7ea468157e661e189: start","job_status":"start","queue_duration_s":3.526388,"scheduling_latency_s":3.526412} gitlab # [ 418.640301] gitaly[890]: time="2026-08-23T07:17:34.243Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPPTTV4SEGG0ZBQVMXWFB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:34.233" grpc.time_ms=9.288 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.07 seconds) gitlab # [ 418.653910] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.392Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"7ed157b7ea468157e661e189","created_at":"2026-08-23T07:17:30.821Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.830Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-7ed157b7ea468157e661e189: done: 0.035689 sec","job_status":"done","queue_duration_s":3.526388,"scheduling_latency_s":3.526412,"redis_calls":10,"redis_duration_s":0.001457,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000309,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002654,"duration_s":0.035689,"completed_at":"2026-08-23T07:17:34.392Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.698895] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.394Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"678087986bb841125b889bbb","created_at":"2026-08-23T07:17:30.831Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.841Z","job_size_bytes":19,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-678087986bb841125b889bbb: start","job_status":"start","queue_duration_s":3.552588,"scheduling_latency_s":3.552611} gitlab # [ 418.715476] gitaly[890]: time="2026-08-23T07:17:34.350Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPPYGEECSKMXN5G1B0XD9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:34.340" grpc.time_ms=9.985 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 418.728927] gitaly[890]: time="2026-08-23T07:17:34.422Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPQ0FC3X8HF6XY3APT9QM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:34.412" pid=890 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 418.739408] nixbot[3473]: INFO: ::ffff:127.0.0.1:60526 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab # [ 418.741470] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.429Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"678087986bb841125b889bbb","created_at":"2026-08-23T07:17:30.831Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.841Z","job_size_bytes":19,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-678087986bb841125b889bbb: done: 0.034947 sec","job_status":"done","queue_duration_s":3.552588,"scheduling_latency_s":3.552611,"redis_calls":11,"redis_duration_s":0.003999,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001194,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002494,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000311,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021574,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002358,"duration_s":0.034947,"completed_at":"2026-08-23T07:17:34.428Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.786668] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.430Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"cd0045b46fb85c3f4bbaf2eb","created_at":"2026-08-23T07:17:30.846Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.854Z","job_size_bytes":66,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-cd0045b46fb85c3f4bbaf2eb: start","job_status":"start","queue_duration_s":3.576125,"scheduling_latency_s":3.576143} gitlab # [ 418.804127] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:34 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 80 gitlab # [ 418.807323] gitlab-workhorse[817]: time="2026-08-23T07:17:34Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 418.809252] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:34 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 85 gitlab # [ 418.811236] gitaly[890]: time="2026-08-23T07:17:34.422Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPQ0FC3X8HF6XY3APT9QM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:34.412" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 418.825082] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.468Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"cd0045b46fb85c3f4bbaf2eb","created_at":"2026-08-23T07:17:30.846Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.854Z","job_size_bytes":66,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-cd0045b46fb85c3f4bbaf2eb: done: 0.037961 sec","job_status":"done","queue_duration_s":3.576125,"scheduling_latency_s":3.576143,"redis_calls":10,"redis_duration_s":0.002351,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000355,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001545,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000451,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02449,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000342,"duration_s":0.037961,"completed_at":"2026-08-23T07:17:34.468Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006386,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.871808] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.470Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"cf7cef34802e1c27d6331474","created_at":"2026-08-23T07:17:30.856Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.863Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-cf7cef34802e1c27d6331474: start","job_status":"start","queue_duration_s":3.606804,"scheduling_latency_s":3.606821} gitlab # [ 418.888451] gitaly[890]: time="2026-08-23T07:17:34.423Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPQ0FC3X8HF6XY3APT9QM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:34.412" grpc.time_ms=10.441 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 418.903278] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.517Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"cf7cef34802e1c27d6331474","created_at":"2026-08-23T07:17:30.856Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.863Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-cf7cef34802e1c27d6331474: done: 0.046995 sec","job_status":"done","queue_duration_s":3.606804,"scheduling_latency_s":3.606821,"redis_calls":10,"redis_duration_s":0.005772,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001108,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003501,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00092614,"duration_s":0.046995,"completed_at":"2026-08-23T07:17:34.517Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005544,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 418.947925] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.520Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"933badf9fc438fd6a62b3d24","created_at":"2026-08-23T07:17:30.873Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.880Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-933badf9fc438fd6a62b3d24: start","job_status":"start","queue_duration_s":3.639916,"scheduling_latency_s":3.639936} gitlab # [ 418.964918] gitaly[890]: time="2026-08-23T07:17:34.542Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=6 command.system_time_ms=5 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPQ3Y0ZSQFBN5EJE7365M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:34.521" grpc.time_ms=20.171 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 418.978203] gitaly[890]: time="2026-08-23T07:17:34.630Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPQ6HT0VW86HWESKBVK4P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:34.610" pid=890 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 418.988721] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.564Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"933badf9fc438fd6a62b3d24","created_at":"2026-08-23T07:17:30.873Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.880Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-933badf9fc438fd6a62b3d24: done: 0.043845 sec","job_status":"done","queue_duration_s":3.639916,"scheduling_latency_s":3.639936,"redis_calls":10,"redis_duration_s":0.001677,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00035,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000366,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025216,"duration_s":0.043845,"completed_at":"2026-08-23T07:17:34.564Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.034797] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.565Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f41814e7b65bfdc98b006b72","created_at":"2026-08-23T07:17:30.881Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.887Z","job_size_bytes":6,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f41814e7b65bfdc98b006b72: start","job_status":"start","queue_duration_s":3.677637,"scheduling_latency_s":3.677653} gitlab # [ 419.050722] gitaly[890]: time="2026-08-23T07:17:34.630Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPQ6HT0VW86HWESKBVK4P grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:34.610" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 419.065060] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.590Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"f41814e7b65bfdc98b006b72","created_at":"2026-08-23T07:17:30.881Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.887Z","job_size_bytes":6,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-f41814e7b65bfdc98b006b72: done: 0.024623 sec","job_status":"done","queue_duration_s":3.677637,"scheduling_latency_s":3.677653,"redis_calls":10,"redis_duration_s":0.001494,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000324,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000867,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000303,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002595,"duration_s":0.024623,"completed_at":"2026-08-23T07:17:34.590Z","load_balancing_strategy":"primary","db_duration_s":0.00282,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.109705] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.591Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"04c6f8b83de36bc0ac7c6482","created_at":"2026-08-23T07:17:30.888Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.893Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-04c6f8b83de36bc0ac7c6482: start","job_status":"start","queue_duration_s":3.697358,"scheduling_latency_s":3.697375} gitlab # [ 419.125101] gitaly[890]: time="2026-08-23T07:17:34.631Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPQ6HT0VW86HWESKBVK4P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-23T07:17:34.610" grpc.time_ms=21.155 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 419.140050] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.642Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"04c6f8b83de36bc0ac7c6482","created_at":"2026-08-23T07:17:30.888Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.893Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-04c6f8b83de36bc0ac7c6482: done: 0.050749 sec","job_status":"done","queue_duration_s":3.697358,"scheduling_latency_s":3.697375,"redis_calls":10,"redis_duration_s":0.006905,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001008,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002278,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003619,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031366,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00160136,"duration_s":0.050749,"completed_at":"2026-08-23T07:17:34.641Z","load_balancing_strategy":"primary","db_duration_s":0.008847,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.183117] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.643Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"a5d5db25a237a6f3c415246c","created_at":"2026-08-23T07:17:30.901Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.907Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-a5d5db25a237a6f3c415246c: start","job_status":"start","queue_duration_s":3.736262,"scheduling_latency_s":3.736279} gitlab # [ 419.199381] gitaly[890]: time="2026-08-23T07:17:34.756Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPQAG31F9NV7F9953SF3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:04.654" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:34.755" grpc.time_ms=0.722 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.212276] nixbot[3473]: {"ts": "2026-08-23T07:17:35.014Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe \"HTTP/1.1 201 Created\""} gitlab # [ 419.214960] nixbot[3473]: {"ts": "2026-08-23T07:17:35.028Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-fd0c5ecfa8b7-4"} gitlab # [ 419.218490] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.741Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"a5d5db25a237a6f3c415246c","created_at":"2026-08-23T07:17:30.901Z","trace_propagation_headers":{"sentry-trace":"ea4efa6486de4dc2abe9258e308c4860-eb8c46b9c41e4112","baggage":"sentry-trace_id=ea4efa6486de4dc2abe9258e308c4860,sentry-release=Unknown"},"correlation_id":"01M0PQKYMWMEQN56Q7X5X8A2TV","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:30.907Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-a5d5db25a237a6f3c415246c: done: 0.097202 sec","job_status":"done","queue_duration_s":3.736262,"scheduling_latency_s":3.736279,"redis_calls":14,"redis_duration_s":0.005856,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000304,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003759,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001793,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.059289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0009543,"duration_s":0.097202,"completed_at":"2026-08-23T07:17:34.741Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.263165] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.745Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"7f5e86fac2370dfa1f0d367e","created_at":"2026-08-23T07:17:31.187Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-2f4cfd756c5d40f3","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:31.196Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-7f5e86fac2370dfa1f0d367e: start","job_status":"start","queue_duration_s":3.548628,"scheduling_latency_s":3.548672} gitlab # [ 419.279617] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:35 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 339 gitlab # [ 419.282622] gitaly[890]: time="2026-08-23T07:17:34.776Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPQAG31F9NV7F9953SF3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-23T07:18:04.666" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:34.766" grpc.time_ms=9.316 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.296760] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.839Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"7f5e86fac2370dfa1f0d367e","created_at":"2026-08-23T07:17:31.187Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-2f4cfd756c5d40f3","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:31.196Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-7f5e86fac2370dfa1f0d367e: done: 0.09447 sec","job_status":"done","queue_duration_s":3.548628,"scheduling_latency_s":3.548672,"redis_calls":19,"redis_duration_s":0.0068650000000000004,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002194,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000982,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002702,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000987,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.070161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01468256,"duration_s":0.09447,"completed_at":"2026-08-23T07:17:34.839Z","load_balancing_strategy":"primary","db_duration_s":0.011123,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.342310] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.841Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","08a5c533a6a3dbb430a6021b"],"class":"WebHooks::LogExecutionWorker","jid":"954186b27a3995dd4349328b","created_at":"2026-08-23T07:17:32.868Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-d1593d861b7b4684","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dcfa0982cff3c489b17ca18d8e3f4f87a8d3e795baaf5b9ca9989ac990276f57","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:32.882Z","job_size_bytes":2592,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-954186b27a3995dd4349328b: start","job_status":"start","queue_duration_s":1.958757,"scheduling_latency_s":1.958786} gitlab # [ 419.359235] nix-daemon[3690]: accepted connection from pid 4323, user nixbot gitlab # [ 419.360168] nix-daemon[3690]: accepted connection from pid 4351, user nixbot gitlab # [ 419.361096] gitaly[890]: time="2026-08-23T07:17:34.793Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPQAG31F9NV7F9953SF3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:44.122" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:34.783" grpc.time_ms=9.492 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.374425] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.899Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","08a5c533a6a3dbb430a6021b"],"class":"WebHooks::LogExecutionWorker","jid":"954186b27a3995dd4349328b","created_at":"2026-08-23T07:17:32.868Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-d1593d861b7b4684","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dcfa0982cff3c489b17ca18d8e3f4f87a8d3e795baaf5b9ca9989ac990276f57","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:32.882Z","job_size_bytes":2592,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-954186b27a3995dd4349328b: done: 0.058335 sec","job_status":"done","queue_duration_s":1.958757,"scheduling_latency_s":1.958786,"redis_calls":10,"redis_duration_s":0.002321,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000366,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000603,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004246,"duration_s":0.058335,"completed_at":"2026-08-23T07:17:34.899Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010998,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.420072] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:34.901Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"61f24a5d1b82f24ff31ffe75","created_at":"2026-08-23T07:17:33.733Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-78c4d32ac3c44308","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:33.740Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-61f24a5d1b82f24ff31ffe75: start","job_status":"start","queue_duration_s":1.161319,"scheduling_latency_s":1.161346} gitlab # [ 419.435818] nixbot[3473]: {"ts": "2026-08-23T07:17:35.195Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-fd0c5ecfa8b7-4", "argv0": "bwrap"} gitlab # [ 419.438442] gitaly[890]: time="2026-08-23T07:17:34.815Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPQAG31F9NV7F9953SF3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-23T07:17:44.153" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:17:34.814" grpc.time_ms=0.631 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.449738] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.240Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"61f24a5d1b82f24ff31ffe75","created_at":"2026-08-23T07:17:33.733Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-78c4d32ac3c44308","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:33.740Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3417,"job_status":"rescheduled","message":"PipelineProcessWorker JID-61f24a5d1b82f24ff31ffe75: rescheduled"} gitlab # [ 419.464946] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.248Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"61f24a5d1b82f24ff31ffe75","created_at":"2026-08-23T07:17:33.733Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-78c4d32ac3c44308","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:33.740Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-61f24a5d1b82f24ff31ffe75: done: 0.346876 sec","job_status":"done","queue_duration_s":1.161319,"scheduling_latency_s":1.161346,"gitaly_calls":3,"gitaly_duration_s":0.106967,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.018185,"redis_read_bytes":151,"redis_write_bytes":18015,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000635,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001132,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.004198,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12314,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.006378,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001325,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00126,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002622,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.057,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.011,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.011,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.032,"db_ci_duration_s":0.025,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.173779,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.29282622,"duration_s":0.346876,"completed_at":"2026-08-23T07:17:35.248Z","load_balancing_strategy":"primary","db_duration_s":0.058018,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 419.516540] gitaly[890]: time="2026-08-23T07:17:34.831Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPQAG31F9NV7F9953SF3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-23T07:17:44.160" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:34.821" grpc.time_ms=9.476 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.529722] gitaly[890]: time="2026-08-23T07:17:34.879Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQPQAG31F9NV7F9953SF3G grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4152 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:17:34.878" grpc.time_ms=0.647 pid=890 span.kind=server system=grpc gitlab # [ 419.539338] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.250Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","61eff7ab0434a144cad43cd0"],"class":"WebHooks::LogExecutionWorker","jid":"5dcb1500678370a1f4f217df","created_at":"2026-08-23T07:17:34.038Z","trace_propagation_headers":{"sentry-trace":"8c63ceef6fc44fb6a524a5a4c2537ec1-9932e33d3fec40a9","baggage":"sentry-trace_id=8c63ceef6fc44fb6a524a5a4c2537ec1,sentry-release=Unknown"},"correlation_id":"01M0PQKXNX6YHTPY4EVZHRNQKJ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:568d67d53c09ef746ef352d593f0f30c427bfbf7b6faa64e70762897963a55f5","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:34.045Z","job_size_bytes":2591,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-5dcb1500678370a1f4f217df: start","job_status":"start","queue_duration_s":1.205761,"scheduling_latency_s":1.205788} gitlab # [ 419.556591] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.289Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","61eff7ab0434a144cad43cd0"],"class":"WebHooks::LogExecutionWorker","jid":"5dcb1500678370a1f4f217df","created_at":"2026-08-23T07:17:34.038Z","trace_propagation_headers":{"sentry-trace":"8c63ceef6fc44fb6a524a5a4c2537ec1-9932e33d3fec40a9","baggage":"sentry-trace_id=8c63ceef6fc44fb6a524a5a4c2537ec1,sentry-release=Unknown"},"correlation_id":"01M0PQKXNX6YHTPY4EVZHRNQKJ","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:568d67d53c09ef746ef352d593f0f30c427bfbf7b6faa64e70762897963a55f5","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:34.045Z","job_size_bytes":2591,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-5dcb1500678370a1f4f217df: done: 0.039176 sec","job_status":"done","queue_duration_s":1.205761,"scheduling_latency_s":1.205788,"redis_calls":7,"redis_duration_s":0.0023420000000000003,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00161,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000732,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021833,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039176,"completed_at":"2026-08-23T07:17:35.289Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00606,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.600677] nix-daemon[3690]: accepted connection from pid 4361, user nixbot gitlab # [ 419.601617] gitaly[890]: time="2026-08-23T07:17:34.910Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQPQAG31F9NV7F9953SF3G grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:17:34.909" grpc.time_ms=0.649 pid=890 span.kind=server system=grpc gitlab # [ 419.611281] gitaly[890]: time="2026-08-23T07:17:34.918Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPQAG31F9NV7F9953SF3G diskcache=c57e1393-6278-4c62-8879-214fccd26770 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:17:44.173" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:17:34.834" pid=890 ref=refs/keep-around/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe remote_ip="2001:db8:1::1" revision=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe span.kind=server system=grpc username=root gitlab # [ 419.622875] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.294Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"92aa36f57639bc6321022a9e","created_at":"2026-08-23T07:17:34.814Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-914c6e28f8c84d46","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:34.824Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-92aa36f57639bc6321022a9e: start","job_status":"start","queue_duration_s":0.469165,"scheduling_latency_s":0.469204} gitlab # [ 419.641079] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.441Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"92aa36f57639bc6321022a9e","created_at":"2026-08-23T07:17:34.814Z","trace_propagation_headers":{"sentry-trace":"9b821c796030456d8a89e2224366540e-914c6e28f8c84d46","baggage":"sentry-trace_id=9b821c796030456d8a89e2224366540e,sentry-release=Unknown"},"correlation_id":"01M0PQKRCXE5NV23BGGFG5PKYF","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:34.824Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-92aa36f57639bc6321022a9e: done: 0.148008 sec","job_status":"done","queue_duration_s":0.469165,"scheduling_latency_s":0.469204,"redis_calls":11,"redis_duration_s":0.003318,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000853,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001863,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000602,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00049036,"duration_s":0.148008,"completed_at":"2026-08-23T07:17:35.441Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe' gitlab # [ 419.686185] gitaly[890]: time="2026-08-23T07:17:34.918Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=81 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5383 command.oublock=8 command.real_time_ms=78 command.spawn_token_fork_ms=2 command.system_time_ms=57 command.user_time_ms=24 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPQAG31F9NV7F9953SF3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-23T07:17:44.173" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-23T07:17:34.834" grpc.time_ms=84.124 pid=890 ref=refs/keep-around/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe remote_ip="2001:db8:1::1" revision=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe span.kind=server system=grpc username=root gitlab # [ 419.701164] nix-daemon[3690]: accepted connection from pid 4371, user nixbot gitlab # [ 419.702021] nix-daemon[3690]: accepted connection from pid 4361, user nixbot gitlab # [ 419.702870] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.443Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1303aa40a592d576d7fd54ee","created_at":"2026-08-23T07:17:34.925Z","trace_propagation_headers":{"sentry-trace":"6bd2a8d832d04c46b7633949e713d367-5811adbd8ba24819","baggage":"sentry-trace_id=6bd2a8d832d04c46b7633949e713d367,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQPQAG31F9NV7F9953SF3G","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:34.928Z","job_size_bytes":65,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1303aa40a592d576d7fd54ee: start","job_status":"start","queue_duration_s":0.514649,"scheduling_latency_s":0.514674} gitlab # [ 419.718283] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.481Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"1303aa40a592d576d7fd54ee","created_at":"2026-08-23T07:17:34.925Z","trace_propagation_headers":{"sentry-trace":"6bd2a8d832d04c46b7633949e713d367-5811adbd8ba24819","baggage":"sentry-trace_id=6bd2a8d832d04c46b7633949e713d367,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQPQAG31F9NV7F9953SF3G","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:34.928Z","job_size_bytes":65,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-1303aa40a592d576d7fd54ee: done: 0.038398 sec","job_status":"done","queue_duration_s":0.514649,"scheduling_latency_s":0.514674,"redis_calls":7,"redis_duration_s":0.001122,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000821,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000301,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038398,"completed_at":"2026-08-23T07:17:35.481Z","load_balancing_strategy":"primary","db_duration_s":0.008842,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 419.759799] gitaly[890]: time="2026-08-23T07:17:34.923Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPQAG31F9NV7F9953SF3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:04.821" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:34.921" grpc.time_ms=1.155 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.772652] gitaly[890]: time="2026-08-23T07:17:35.048Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQPP0AJYPTTMW6VKMFPVEY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:17:35.047" grpc.time_ms=0.55 pid=890 span.kind=server system=grpc gitlab # [ 419.782132] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.483Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4446340e6edf6cda1c1902ff","created_at":"2026-08-23T07:17:34.930Z","trace_propagation_headers":{"sentry-trace":"6bd2a8d832d04c46b7633949e713d367-5811adbd8ba24819","baggage":"sentry-trace_id=6bd2a8d832d04c46b7633949e713d367,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQPQAG31F9NV7F9953SF3G","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:34.933Z","job_size_bytes":65,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4446340e6edf6cda1c1902ff: start","job_status":"start","queue_duration_s":0.550038,"scheduling_latency_s":0.55006} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', in 0.11 seconds) (finished: subtest: push delivers the webhook, in 93.21 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses gitlab # [ 419.799634] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.557Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"4446340e6edf6cda1c1902ff","created_at":"2026-08-23T07:17:34.930Z","trace_propagation_headers":{"sentry-trace":"6bd2a8d832d04c46b7633949e713d367-5811adbd8ba24819","baggage":"sentry-trace_id=6bd2a8d832d04c46b7633949e713d367,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQPQAG31F9NV7F9953SF3G","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:34.933Z","job_size_bytes":65,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-4446340e6edf6cda1c1902ff: done: 0.074048 sec","job_status":"done","queue_duration_s":0.550038,"scheduling_latency_s":0.55006,"redis_calls":10,"redis_duration_s":0.003766,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000803,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.002963,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041663,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.074048,"completed_at":"2026-08-23T07:17:35.557Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025395,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 419.844395] gitaly[890]: time="2026-08-23T07:17:35.074Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQPP0AJYPTTMW6VKMFPVEY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:17:35.073" grpc.time_ms=0.439 pid=890 span.kind=server system=grpc gitlab # [ 419.853833] gitaly[890]: time="2026-08-23T07:17:35.097Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQPP0AJYPTTMW6VKMFPVEY grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:17:35.097" grpc.time_ms=0.479 pid=890 span.kind=server system=grpc gitlab # [ 419.863766] nixbot[3473]: INFO: ::ffff:127.0.0.1:60536 - "GET /api/repos/gitlab/root/test-flake/builds?commit=fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 200 OK gitlab # [ 419.865819] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.558Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"99387cafaaab7cff388cceb3","created_at":"2026-08-23T07:17:34.993Z","trace_propagation_headers":{"sentry-trace":"6bd2a8d832d04c46b7633949e713d367-5811adbd8ba24819","baggage":"sentry-trace_id=6bd2a8d832d04c46b7633949e713d367,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQPQAG31F9NV7F9953SF3G","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:34.996Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-99387cafaaab7cff388cceb3: start","job_status":"start","queue_duration_s":0.562142,"scheduling_latency_s":0.562164} gitlab # [ 419.881704] gitaly[890]: time="2026-08-23T07:17:35.105Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPP0AJYPTTMW6VKMFPVEY diskcache=90383d0c-dd33-43cd-ad3a-ad0ece01f256 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:18:05.009" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:35.010" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.891144] gitaly[890]: time="2026-08-23T07:17:35.106Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=91 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7285 command.oublock=0 command.real_time_ms=90 command.spawn_token_fork_ms=5 command.system_time_ms=40 command.user_time_ms=51 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPP0AJYPTTMW6VKMFPVEY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:18:05.009" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:35.010" grpc.time_ms=95.295 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.904345] gitaly[890]: time="2026-08-23T07:17:35.177Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPP0AJYPTTMW6VKMFPVEY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:18:05.174" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:35.175" grpc.time_ms=1.567 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 419.916944] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.740Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"99387cafaaab7cff388cceb3","created_at":"2026-08-23T07:17:34.993Z","trace_propagation_headers":{"sentry-trace":"6bd2a8d832d04c46b7633949e713d367-5811adbd8ba24819","baggage":"sentry-trace_id=6bd2a8d832d04c46b7633949e713d367,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQPQAG31F9NV7F9953SF3G","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:34.996Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-99387cafaaab7cff388cceb3: done: 0.182069 sec","job_status":"done","queue_duration_s":0.562142,"scheduling_latency_s":0.562164,"gitaly_calls":2,"gitaly_duration_s":0.007503,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008708,"redis_read_bytes":80,"redis_write_bytes":5121,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.000771,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000858,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000242,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1132,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00315,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000195,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.00044,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002281,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.006,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.01,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.109676,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13012336,"duration_s":0.182069,"completed_at":"2026-08-23T07:17:35.740Z","load_balancing_strategy":"primary","db_duration_s":0.055972,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 419.968236] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.746Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"46f157779fd4869fb52d1c89","created_at":"2026-08-23T07:17:34.997Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.001Z","job_size_bytes":23,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-46f157779fd4869fb52d1c89: start","job_status":"start","queue_duration_s":0.744276,"scheduling_latency_s":0.744319} gitlab # [ 419.984810] gitaly[890]: time="2026-08-23T07:17:35.228Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPP0AJYPTTMW6VKMFPVEY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:05.226" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:35.227" grpc.time_ms=0.88 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses, in 0.21 seconds) gitlab # [ 419.997064] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.817Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"46f157779fd4869fb52d1c89","created_at":"2026-08-23T07:17:34.997Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.001Z","job_size_bytes":23,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-46f157779fd4869fb52d1c89: done: 0.07138 sec","job_status":"done","queue_duration_s":0.744276,"scheduling_latency_s":0.744319,"redis_calls":7,"redis_duration_s":0.0046370000000000005,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00366,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042529,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.07138,"completed_at":"2026-08-23T07:17:35.817Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018868,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 420.039416] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.819Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ff83fb29aa5d0c5356fb4564","created_at":"2026-08-23T07:17:35.112Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.115Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ff83fb29aa5d0c5356fb4564: start","job_status":"start","queue_duration_s":0.703629,"scheduling_latency_s":0.703656} gitlab # [ 420.056550] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:35 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 142 gitlab # [ 420.059109] gitaly[890]: time="2026-08-23T07:17:35.650Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPQAG31F9NV7F9953SF3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:18:05.648" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:35.649" grpc.time_ms=1.103 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 420.073138] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.864Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"ff83fb29aa5d0c5356fb4564","created_at":"2026-08-23T07:17:35.112Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.115Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-ff83fb29aa5d0c5356fb4564: done: 0.045346 sec","job_status":"done","queue_duration_s":0.703629,"scheduling_latency_s":0.703656,"redis_calls":7,"redis_duration_s":0.007372999999999999,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006199,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001174,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024012,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045346,"completed_at":"2026-08-23T07:17:35.864Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009961,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.116155] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.866Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ace878106a4168225ebb4ffe","created_at":"2026-08-23T07:17:35.125Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.130Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ace878106a4168225ebb4ffe: start","job_status":"start","queue_duration_s":0.736219,"scheduling_latency_s":0.736243} gitlab # [ 420.131853] gitaly[890]: time="2026-08-23T07:17:35.708Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPQAG31F9NV7F9953SF3G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:05.707" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:35.707" grpc.time_ms=0.695 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 420.144423] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.902Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ace878106a4168225ebb4ffe","created_at":"2026-08-23T07:17:35.125Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.130Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ace878106a4168225ebb4ffe: done: 0.035527 sec","job_status":"done","queue_duration_s":0.736219,"scheduling_latency_s":0.736243,"redis_calls":7,"redis_duration_s":0.001976,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001438,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000538,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035527,"completed_at":"2026-08-23T07:17:35.902Z","load_balancing_strategy":"primary","db_duration_s":0.008778,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.186381] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.904Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"633d42f9bd989808417809ef","created_at":"2026-08-23T07:17:35.143Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.146Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-633d42f9bd989808417809ef: start","job_status":"start","queue_duration_s":0.757872,"scheduling_latency_s":0.757896} gitlab # [ 420.201828] gitaly[890]: time="2026-08-23T07:17:35.775Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPRAWYKXVZBYBKB115RA5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:05.674" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:35.774" grpc.time_ms=0.99 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 420.214495] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.941Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"633d42f9bd989808417809ef","created_at":"2026-08-23T07:17:35.143Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.146Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-633d42f9bd989808417809ef: done: 0.0375 sec","job_status":"done","queue_duration_s":0.757872,"scheduling_latency_s":0.757896,"redis_calls":10,"redis_duration_s":0.002836,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001482,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000792,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0375,"completed_at":"2026-08-23T07:17:35.941Z","load_balancing_strategy":"primary","db_duration_s":0.008827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.257799] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.943Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"ba7637a7de84c7d933733c36","created_at":"2026-08-23T07:17:35.147Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.149Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-ba7637a7de84c7d933733c36: start","job_status":"start","queue_duration_s":0.79409,"scheduling_latency_s":0.794114} gitlab # [ 420.274311] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.974Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"ba7637a7de84c7d933733c36","created_at":"2026-08-23T07:17:35.147Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.149Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-ba7637a7de84c7d933733c36: done: 0.030818 sec","job_status":"done","queue_duration_s":0.79409,"scheduling_latency_s":0.794114,"redis_calls":7,"redis_duration_s":0.00201,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001443,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000567,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030818,"completed_at":"2026-08-23T07:17:35.974Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.317820] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:35.976Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3a41fabac1228b50e6c44cf0","created_at":"2026-08-23T07:17:35.150Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.152Z","job_size_bytes":19,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3a41fabac1228b50e6c44cf0: start","job_status":"start","queue_duration_s":0.823153,"scheduling_latency_s":0.823171} gitlab # [ 420.334025] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:36.005Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"3a41fabac1228b50e6c44cf0","created_at":"2026-08-23T07:17:35.150Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.152Z","job_size_bytes":19,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-3a41fabac1228b50e6c44cf0: done: 0.029349 sec","job_status":"done","queue_duration_s":0.823153,"scheduling_latency_s":0.823171,"redis_calls":8,"redis_duration_s":0.002236,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001744,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000492,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016762,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029349,"completed_at":"2026-08-23T07:17:36.005Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007558,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.376783] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:36.006Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ae100ef0bac14297b7f34c03","created_at":"2026-08-23T07:17:35.154Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.155Z","job_size_bytes":66,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ae100ef0bac14297b7f34c03: start","job_status":"start","queue_duration_s":0.850975,"scheduling_latency_s":0.850992} gitlab # [ 420.394238] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:36.032Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"ae100ef0bac14297b7f34c03","created_at":"2026-08-23T07:17:35.154Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.155Z","job_size_bytes":66,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-ae100ef0bac14297b7f34c03: done: 0.025462 sec","job_status":"done","queue_duration_s":0.850975,"scheduling_latency_s":0.850992,"redis_calls":7,"redis_duration_s":0.0018349999999999998,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001321,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016209,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025462,"completed_at":"2026-08-23T07:17:36.032Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.438176] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:36.033Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5dd1cb4f293c9853751a6a44","created_at":"2026-08-23T07:17:35.156Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.158Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5dd1cb4f293c9853751a6a44: start","job_status":"start","queue_duration_s":0.87558,"scheduling_latency_s":0.875596} gitlab # [ 420.454897] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:36.064Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"5dd1cb4f293c9853751a6a44","created_at":"2026-08-23T07:17:35.156Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.158Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-5dd1cb4f293c9853751a6a44: done: 0.030294 sec","job_status":"done","queue_duration_s":0.87558,"scheduling_latency_s":0.875596,"redis_calls":7,"redis_duration_s":0.00201,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001437,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000573,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017537,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030294,"completed_at":"2026-08-23T07:17:36.064Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.499000] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:36.065Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"4e37ef1651aab40d917c2a99","created_at":"2026-08-23T07:17:35.158Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.160Z","job_size_bytes":6,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-4e37ef1651aab40d917c2a99: start","job_status":"start","queue_duration_s":0.905359,"scheduling_latency_s":0.905378} gitlab # [ 420.514763] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:36.081Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"4e37ef1651aab40d917c2a99","created_at":"2026-08-23T07:17:35.158Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.160Z","job_size_bytes":6,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-4e37ef1651aab40d917c2a99: done: 0.015607 sec","job_status":"done","queue_duration_s":0.905359,"scheduling_latency_s":0.905378,"redis_calls":7,"redis_duration_s":0.001976,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001513,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000463,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015607,"completed_at":"2026-08-23T07:17:36.081Z","load_balancing_strategy":"primary","db_duration_s":0.000724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.556723] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:36.083Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0825a7b70fd832e7603d1b45","created_at":"2026-08-23T07:17:35.161Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.162Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0825a7b70fd832e7603d1b45: start","job_status":"start","queue_duration_s":0.920306,"scheduling_latency_s":0.920321} gitlab # [ 420.571976] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:36.110Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0825a7b70fd832e7603d1b45","created_at":"2026-08-23T07:17:35.161Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.162Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0825a7b70fd832e7603d1b45: done: 0.027132 sec","job_status":"done","queue_duration_s":0.920306,"scheduling_latency_s":0.920321,"redis_calls":7,"redis_duration_s":0.0018579999999999998,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001349,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000509,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027132,"completed_at":"2026-08-23T07:17:36.110Z","load_balancing_strategy":"primary","db_duration_s":0.005821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 420.613340] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:36.111Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"eead857fbc55e93b5ec08e09","created_at":"2026-08-23T07:17:35.240Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.242Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-eead857fbc55e93b5ec08e09: start","job_status":"start","queue_duration_s":0.868976,"scheduling_latency_s":0.868994} gitlab # [ 420.628940] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:36.141Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"eead857fbc55e93b5ec08e09","created_at":"2026-08-23T07:17:35.240Z","trace_propagation_headers":{"sentry-trace":"a157ec7f5e57437bb59a750fc721aa91-4f604f8c245a4a81","baggage":"sentry-trace_id=a157ec7f5e57437bb59a750fc721aa91,sentry-release=Unknown"},"correlation_id":"01M0PQPP0AJYPTTMW6VKMFPVEY","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.242Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-eead857fbc55e93b5ec08e09: done: 0.029916 sec","job_status":"done","queue_duration_s":0.868976,"scheduling_latency_s":0.868994,"redis_calls":8,"redis_duration_s":0.002156,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001694,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000462,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029916,"completed_at":"2026-08-23T07:17:36.141Z","load_balancing_strategy":"primary","db_duration_s":0.006114,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 420.670888] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:36.143Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d53b9ca389df9f1400fe1ee7","created_at":"2026-08-23T07:17:35.629Z","trace_propagation_headers":{"sentry-trace":"6bd2a8d832d04c46b7633949e713d367-f76a77f06a014282","baggage":"sentry-trace_id=6bd2a8d832d04c46b7633949e713d367,sentry-release=Unknown"},"correlation_id":"01M0PQPQAG31F9NV7F9953SF3G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.631Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d53b9ca389df9f1400fe1ee7: start","job_status":"start","queue_duration_s":0.511408,"scheduling_latency_s":0.511423} gitlab # [ 420.688508] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:36.210Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"d53b9ca389df9f1400fe1ee7","created_at":"2026-08-23T07:17:35.629Z","trace_propagation_headers":{"sentry-trace":"6bd2a8d832d04c46b7633949e713d367-f76a77f06a014282","baggage":"sentry-trace_id=6bd2a8d832d04c46b7633949e713d367,sentry-release=Unknown"},"correlation_id":"01M0PQPQAG31F9NV7F9953SF3G","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:35.631Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-d53b9ca389df9f1400fe1ee7: done: 0.067848 sec","job_status":"done","queue_duration_s":0.511408,"scheduling_latency_s":0.511423,"redis_calls":7,"redis_duration_s":0.001886,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001368,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000518,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038717,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.067848,"completed_at":"2026-08-23T07:17:36.210Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025597,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses gitlab # [ 421.212858] gitaly[890]: time="2026-08-23T07:17:37.068Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPSHPGBRJP1X6233KSF2G grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:07.066" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:37.067" grpc.time_ms=1.314 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses, in 0.28 seconds) gitlab # [ 421.280871] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 186 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses gitlab # [ 422.448689] gitaly[890]: time="2026-08-23T07:17:38.304Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPTRJ1B9C02D0JN0EPGZA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:08.201" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:38.302" grpc.time_ms=1.302 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses, in 0.22 seconds) gitlab # [ 422.502412] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:38 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 164 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses gitlab # [ 423.665657] gitaly[890]: time="2026-08-23T07:17:39.521Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPVYPZRSZQ733TSKX69V6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:09.419" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:39.519" grpc.time_ms=1.278 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses, in 0.22 seconds) gitlab # [ 423.719514] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:39 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 160 gitlab # [ 424.096314] gitaly[890]: time="2026-08-23T07:17:39.953Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:09.850" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:39.951" grpc.time_ms=1.36 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.196493] gitaly[890]: time="2026-08-23T07:17:40.053Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:50.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:40.035" grpc.time_ms=17.707 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.288786] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:40.143Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"cdd1a9dbdf3a30474fa03823","created_at":"2026-08-23T07:17:40.126Z","trace_propagation_headers":{"sentry-trace":"bbd407eb2c27480592d27b0582de8fbb-5de77329b4b24db6","baggage":"sentry-trace_id=bbd407eb2c27480592d27b0582de8fbb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQPWBSHNSGY733FAYFTGEJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:40.138Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-cdd1a9dbdf3a30474fa03823: start","job_status":"start","queue_duration_s":0.005518,"scheduling_latency_s":0.005584} gitlab # [ 424.336963] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 340 gitlab # [ 424.344121] nixbot[3473]: {"ts": "2026-08-23T07:17:40.176Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe \"HTTP/1.1 201 Created\""} gitlab # [ 424.432596] gitaly[890]: time="2026-08-23T07:17:40.289Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPWPR0E361J2Z2R8NC3VE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:10.187" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:40.287" grpc.time_ms=1.363 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.512797] gitaly[890]: time="2026-08-23T07:17:40.365Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:17:40.364" grpc.time_ms=0.979 pid=890 span.kind=server system=grpc gitlab # [ 424.537913] gitaly[890]: time="2026-08-23T07:17:40.380Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPWPR0E361J2Z2R8NC3VE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:50.185" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:40.365" grpc.time_ms=14.424 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.561969] gitaly[890]: time="2026-08-23T07:17:40.411Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3894 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:17:40.410" grpc.time_ms=0.585 pid=890 span.kind=server system=grpc gitlab # [ 424.587501] gitaly[890]: time="2026-08-23T07:17:40.444Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-23T07:17:40.443" grpc.time_ms=0.97 pid=890 span.kind=server system=grpc gitlab # [ 424.611140] gitaly[890]: time="2026-08-23T07:17:40.450Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:18:10.315" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:40.316" operations="[repack_refs]" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.630040] gitaly[890]: time="2026-08-23T07:17:40.453Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ diskcache=50a2420b-8bf8-4a8a-b243-f6906157e77b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:18:10.315" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:40.316" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.647261] gitaly[890]: time="2026-08-23T07:17:40.454Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=139 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7097 command.oublock=0 command.real_time_ms=132 command.spawn_token_fork_ms=0 command.system_time_ms=86 command.user_time_ms=53 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:18:10.315" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:40.316" grpc.time_ms=137.947 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.666836] nixbot[3473]: {"ts": "2026-08-23T07:17:40.473Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe \"HTTP/1.1 201 Created\""} gitlab # [ 424.670600] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 286 gitlab # [ 424.674436] gitaly[890]: time="2026-08-23T07:17:40.458Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:18:10.315" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:40.316" pid=890 remote_ip="2001:db8:1::1" repository_info="{false {6 703 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-23 07:15:54.7216794 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 424.688568] gitaly[890]: time="2026-08-23T07:17:40.491Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:18:10.315" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:40.316" pid=890 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 424.703287] gitaly[890]: time="2026-08-23T07:17:40.491Z" level=info msg="optimized repository" clean_stale_data_time=32.6015ms clean_work_trees_time="168.66µs" commit_graph_time="1µs" correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.7µs" pid=890 prune_time=300ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.7µs" storage_name=default system=housekeeping total_time=32.80412ms gitlab # [ 424.709995] gitaly[890]: time="2026-08-23T07:17:40.491Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-23T07:18:10.315" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:40.316" pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses gitlab # [ 424.720049] gitaly[890]: time="2026-08-23T07:17:40.555Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-23T07:18:10.553" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:40.553" grpc.time_ms=1.048 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.732918] gitaly[890]: time="2026-08-23T07:17:40.562Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPX0666DNRHKEQZ6HR7AX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:10.461" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:40.561" grpc.time_ms=0.754 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.748524] gitaly[890]: time="2026-08-23T07:17:40.605Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPWBSHNSGY733FAYFTGEJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:10.601" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:40.601" grpc.time_ms=3.499 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.770695] gitaly[890]: time="2026-08-23T07:17:40.627Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=5 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0PQPX0666DNRHKEQZ6HR7AX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-23T07:17:50.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-23T07:17:40.614" grpc.time_ms=12.853 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 424.785760] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:40.627Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"6f63e37b6e7938049b58dbb6","created_at":"2026-08-23T07:17:40.625Z","trace_propagation_headers":{"sentry-trace":"bbd407eb2c27480592d27b0582de8fbb-55d98e1883a84ef6","baggage":"sentry-trace_id=bbd407eb2c27480592d27b0582de8fbb,sentry-release=Unknown"},"correlation_id":"01M0PQPWBSHNSGY733FAYFTGEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"cdd1a9dbdf3a30474fa03823","job_size_bytes":3,"pid":3417,"job_status":"deduplicated","message":"PipelineProcessWorker JID-6f63e37b6e7938049b58dbb6: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 424.802854] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:40.630Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"cdd1a9dbdf3a30474fa03823","created_at":"2026-08-23T07:17:40.126Z","trace_propagation_headers":{"sentry-trace":"bbd407eb2c27480592d27b0582de8fbb-5de77329b4b24db6","baggage":"sentry-trace_id=bbd407eb2c27480592d27b0582de8fbb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQPWBSHNSGY733FAYFTGEJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:40.138Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3417,"job_status":"rescheduled","message":"PipelineProcessWorker JID-cdd1a9dbdf3a30474fa03823: rescheduled"} gitlab # [ 424.817991] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:40.637Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"cdd1a9dbdf3a30474fa03823","created_at":"2026-08-23T07:17:40.126Z","trace_propagation_headers":{"sentry-trace":"bbd407eb2c27480592d27b0582de8fbb-5de77329b4b24db6","baggage":"sentry-trace_id=bbd407eb2c27480592d27b0582de8fbb,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0PQPWBSHNSGY733FAYFTGEJ","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:40.138Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-cdd1a9dbdf3a30474fa03823: done: 0.493877 sec","job_status":"done","queue_duration_s":0.005518,"scheduling_latency_s":0.005584,"gitaly_calls":3,"gitaly_duration_s":0.16833,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.033269,"redis_read_bytes":239,"redis_write_bytes":21786,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001964,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001799,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.013543,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14471,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.009104,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000463,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001052,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.00338,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":33,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":33,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.065,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":16,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.013,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.017,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.235846,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.4113238,"duration_s":0.493877,"completed_at":"2026-08-23T07:17:40.637Z","load_balancing_strategy":"primary","db_duration_s":0.069018,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 424.868804] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:40.638Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"55cdd596d8bf4cbdb6c7a370","created_at":"2026-08-23T07:17:40.296Z","trace_propagation_headers":{"sentry-trace":"bbd407eb2c27480592d27b0582de8fbb-55d98e1883a84ef6","baggage":"sentry-trace_id=bbd407eb2c27480592d27b0582de8fbb,sentry-release=Unknown"},"correlation_id":"01M0PQPWBSHNSGY733FAYFTGEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:40.301Z","job_size_bytes":23,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-55cdd596d8bf4cbdb6c7a370: start","job_status":"start","queue_duration_s":0.337782,"scheduling_latency_s":0.337803} gitlab # [ 424.885224] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:40.689Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"55cdd596d8bf4cbdb6c7a370","created_at":"2026-08-23T07:17:40.296Z","trace_propagation_headers":{"sentry-trace":"bbd407eb2c27480592d27b0582de8fbb-55d98e1883a84ef6","baggage":"sentry-trace_id=bbd407eb2c27480592d27b0582de8fbb,sentry-release=Unknown"},"correlation_id":"01M0PQPWBSHNSGY733FAYFTGEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:40.301Z","job_size_bytes":23,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-55cdd596d8bf4cbdb6c7a370: done: 0.050924 sec","job_status":"done","queue_duration_s":0.337782,"scheduling_latency_s":0.337803,"redis_calls":7,"redis_duration_s":0.001354,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001006,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000348,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.036037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050924,"completed_at":"2026-08-23T07:17:40.689Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011806,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 424.927938] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:40.691Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"18f11e66025cbe5b1f742147","created_at":"2026-08-23T07:17:40.468Z","trace_propagation_headers":{"sentry-trace":"bbd407eb2c27480592d27b0582de8fbb-55d98e1883a84ef6","baggage":"sentry-trace_id=bbd407eb2c27480592d27b0582de8fbb,sentry-release=Unknown"},"correlation_id":"01M0PQPWBSHNSGY733FAYFTGEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:40.472Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-18f11e66025cbe5b1f742147: start","job_status":"start","queue_duration_s":0.219143,"scheduling_latency_s":0.219165} gitlab # [ 424.945189] gitlab-workhorse[817]: gitlab 2001:db8:1::1 - - [2026/08/23:07:17:40 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 277 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe/statuses, in 0.24 seconds) gitlab # [ 424.947629] gitaly[890]: time="2026-08-23T07:17:40.771Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0PQPX4AF45W84K0F0NT5J1H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-23T07:18:10.670" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-23T07:17:40.770" grpc.time_ms=0.705 pid=890 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root (finished: subtest: eval and build post commit statuses, in 5.17 seconds) gitlab # [ 424.960884] nixbot[3473]: {"ts": "2026-08-23T07:17:40.766Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe \"HTTP/1.1 201 Created\""} (finished: run the VM test script, in 496.08 seconds) gitlab # [ 424.963382] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:40.729Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"18f11e66025cbe5b1f742147","created_at":"2026-08-23T07:17:40.468Z","trace_propagation_headers":{"sentry-trace":"bbd407eb2c27480592d27b0582de8fbb-55d98e1883a84ef6","baggage":"sentry-trace_id=bbd407eb2c27480592d27b0582de8fbb,sentry-release=Unknown"},"correlation_id":"01M0PQPWBSHNSGY733FAYFTGEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63e54343e7f7256ab8a1199953fd73b05666f28484b7429653936cc0ecd1a59c","size_limiter":"validated","enqueued_at":"2026-08-23T07:17:40.472Z","job_size_bytes":3,"pid":3417,"sidekiq_tid":"m8mp","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-18f11e66025cbe5b1f742147: done: 0.037787 sec","job_status":"done","queue_duration_s":0.219143,"scheduling_latency_s":0.219165,"redis_calls":7,"redis_duration_s":0.003268,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002839,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000429,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026034,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037787,"completed_at":"2026-08-23T07:17:40.729Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} test script finished in 496.13s cleanup kill QemuMachine (pid 46) gitlab # [ 425.008718] sidekiq-cluster[3417]: {"severity":"INFO","time":"2026-08-23T07:17:40.731Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["2"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"9608c04077bfa9c4ed9fe8f8","created_at":"2026-08-23T07:17:40.482Z","trace_propagation_headers":{"sentry-trace":"bbd407eb2c27480592d27b0582de8fbb-55d98e1883a84ef6","baggage":"sentry-trace_id=bbd407eb2c27480592d27b0582de8fbb,sentry-release=Unknown"},"correlation_id":"01M0PQPWBSHNSGY733FAYFTGEJ","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_dataqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14) gitlab # _ (finished: cleanup, in 1.62 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-23T07:16:01.980Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': [{'level': 'warning', 'message': "unable to download 'https://cache.nixos.org/…': Could not resolve hostname (6) Could not resolve host: cache.nixos.org", 'count': 1}], 'error': None, 'created_at': '2026-08-23T07:17:34.664261Z', 'started_at': '2026-08-23T07:17:35.019726Z', 'finished_at': None}] [{'id': 5, 'sha': 'fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-23T07:17:34.982Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-23T07:17:34.982Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-23T07:17:34.982Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-23T07:17:34.982Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': 'fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-23T07:17:34.982Z', 'started_at': None, 'finished_at': '2026-08-23T07:17:40.106Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': 'fd0c5ecfa8b741614968f7a13273d6e7a3eb52fe', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-23T07:17:40.429Z', 'started_at': None, 'finished_at': '2026-08-23T07:17:40.701Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]