tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab: QEMU running (pid 46) gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab # Formatting '/build/vm-state-gitlab/tmp.hQ4REKopxy', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) (finished: start all VMs, in 74.47 seconds) gitlab # Discarding device blocks: 0/262144 done gitlab: waiting for unit setup-gitlab.service gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes gitlab: waiting for the VM to finish booting gitlab # Filesystem UUID: 1bb6c3c1-672c-42c6-b01f-2cbb21ba72b4 gitlab # Superblock backups stored on blocks: gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] KASLR enabled gitlab # [ 0.000000] random: crng init done gitlab # [ 0.000000] Machine model: linux,dummy-virt gitlab # [ 0.000000] efi: UEFI not found. gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf] gitlab # [ 0.000000] Zone ranges: gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff] gitlab # [ 0.000000] DMA32 empty gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.000000] Device empty gitlab # [ 0.000000] Movable zone start for each node gitlab # [ 0.000000] Early memory node ranges gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe000000 gitlab # [ 0.000000] psci: probing for conduit method from DT. gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware. gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs gitlab # [ 0.000000] psci: Trusted OS migration not required gitlab # [ 0.000000] psci: SMC Calling Convention v1.1 gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 gitlab # [ 0.000000] Detected PIPT I-cache on CPU0 gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface gitlab # [ 0.000000] CPU features: detected: Spectre-v4 gitlab # [ 0.000000] CPU features: detected: Spectre-BHB gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 gitlab # [ 0.000000] alternatives: applying boot alternatives gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/4cz564bp70gwwkqhzfnzcvrknb17cnh9-nixos-system-gitlab-test/init regInfo=/nix/store/amv35fwx4faq38r3d9dwxzap1r8jmm91-closure-info/registration console=ttyAMA0,115200n8 console=tty0 gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/amv35fwx4faq38r3d9dwxzap1r8jmm91-closure-info/registration", will be passed to user space. gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.000000] software IO TLB: area num 4. gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB) gitlab # [ 0.000000] Fallback order for Node 0: 0 gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1572864 gitlab # [ 0.000000] Policy zone: Normal gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.000000] allocated 12582912 bytes of page_ext gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups gitlab # [ 0.000000] rcu: Hierarchical RCU implementation. gitlab # [ 0.000000] rcu: RCU event tracing is enabled. gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.000000] Rude variant of Tasks RCU enabled. gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled. gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 gitlab # [ 0.000000] GICv3: 256 SPIs implemented gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000 gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000 gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns gitlab # [ 0.000033] arm-pv: using stolen time PV gitlab # [ 0.000985] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.001211] Console: colour dummy device 80x25 gitlab # [ 0.001219] printk: legacy console [tty0] enabled gitlab # [ 0.001420] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) gitlab # [ 0.001427] pid_max: default: 32768 minimum: 301 gitlab # [ 0.001513] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.001650] landlock: Up and running. gitlab # [ 0.001653] Yama: becoming mindful. gitlab # [ 0.002139] LSM support for eBPF active gitlab # [ 0.002368] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.002485] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.003729] cacheinfo: Unable to detect cache hierarchy for CPU 0 gitlab # [ 0.004490] rcu: Hierarchical SRCU implementation. gitlab # [ 0.004494] rcu: Max phase no-delay instances is 1000. gitlab # [ 0.004663] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.005754] fsl-mc MSI: its@8080000 domain created gitlab # [ 0.005851] EFI services will not be available. gitlab # [ 0.006042] smp: Bringing up secondary CPUs ... gitlab # [ 0.006726] Detected PIPT I-cache on CPU1 gitlab # [ 0.006830] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000 gitlab # [ 0.006954] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000 gitlab # [ 0.007100] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40] gitlab # [ 0.008201] Detected PIPT I-cache on CPU2 gitlab # [ 0.008313] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000 gitlab # [ 0.008439] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000 gitlab # [ 0.008568] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40] gitlab # [ 0.009685] Detected PIPT I-cache on CPU3 gitlab # [ 0.009808] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000 gitlab # [ 0.009933] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000 gitlab # [ 0.010062] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40] gitlab # [ 0.010633] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.010660] SMP: Total of 4 processors activated. gitlab # [ 0.010663] CPU: All CPU(s) started at EL1 gitlab # [ 0.010672] CPU features: detected: Branch Target Identification gitlab # [ 0.010677] CPU features: detected: ARMv8.4 Translation Table Level gitlab # [ 0.010679] CPU features: detected: Instruction cache invalidation not required for I/D coherence gitlab # [ 0.010683] CPU features: detected: Data cache clean to the PoU not required for I/D coherence gitlab # [ 0.010686] CPU features: detected: Common not Private translations gitlab # [ 0.010689] CPU features: detected: CRC32 instructions gitlab # [ 0.010692] CPU features: detected: Data cache clean to Point of Deep Persistence gitlab # [ 0.010695] CPU features: detected: Data cache clean to Point of Persistence gitlab # [ 0.010698] CPU features: detected: Data independent timing control (DIT) gitlab # [ 0.010700] CPU features: detected: E0PD gitlab # [ 0.010703] CPU features: detected: Enhanced Counter Virtualization gitlab # [ 0.010705] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) gitlab # [ 0.010708] CPU features: detected: Enhanced Virtualization Traps gitlab # [ 0.010711] CPU features: detected: Fine Grained Traps gitlab # [ 0.010714] CPU features: detected: Generic authentication (architected QARMA5 algorithm) gitlab # [ 0.010717] CPU features: detected: RCpc load-acquire (LDAPR) gitlab # [ 0.010720] CPU features: detected: LSE atomic instructions gitlab # [ 0.010722] CPU features: detected: Privileged Access Never gitlab # [ 0.010725] CPU features: detected: PMUv3 gitlab # [ 0.010727] CPU features: detected: RAS Extension Support gitlab # [ 0.010730] CPU features: detected: RASv1p1 Extension Support gitlab # [ 0.010732] CPU features: detected: Random Number Generator gitlab # [ 0.010734] CPU features: detected: Speculation barrier (SB) gitlab # [ 0.010737] CPU features: detected: Stage-2 Force Write-Back gitlab # [ 0.010739] CPU features: detected: TLB range maintenance instructions gitlab # [ 0.010743] CPU features: detected: Speculative Store Bypassing Safe (SSBS) gitlab # [ 0.010870] alternatives: applying system-wide alternatives gitlab # [ 0.014088] CPU features: detected: BBM Level 2 without TLB conflict abort gitlab # [ 0.014304] Memory: 5963764K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved) gitlab # [ 0.016118] devtmpfs: initialized gitlab # [ 0.020477] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.020552] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.020785] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL gitlab # [ 0.020790] 0 pages in range for non-PLT usage gitlab # [ 0.020791] 508288 pages in range for PLT usage gitlab # [ 0.020955] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.021856] DMI not present or invalid. gitlab # [ 0.025524] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.028381] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.028703] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.030612] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.030646] audit: initializing netlink subsys (disabled) gitlab # [ 0.030988] audit: type=2000 audit(0.028:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.031563] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.031567] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.031573] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.031575] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.031578] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.031693] cpuidle: using governor ladder gitlab # [ 0.031723] cpuidle: using governor menu gitlab # [ 0.031950] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. gitlab # [ 0.032182] ASID allocator initialised with 65536 entries gitlab # [ 0.033344] Serial: AMBA PL011 UART driver gitlab # [ 0.038889] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 gitlab # [ 0.039223] printk: console [ttyAMA0] enabled gitlab # [ 0.049847] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.049869] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.049879] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages gitlab # [ 0.049887] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page gitlab # [ 0.049895] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.049903] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.049912] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages gitlab # [ 0.049920] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page gitlab # [ 0.063829] fbcon: Taking over console gitlab # [ 0.063848] ACPI: Interpreter disabled. gitlab # [ 0.064937] iommu: Default domain type: Translated gitlab # [ 0.064956] iommu: DMA domain TLB invalidation policy: strict mode gitlab # [ 0.074566] SCSI subsystem initialized gitlab # [ 0.075086] usbcore: registered new interface driver usbfs gitlab # [ 0.075113] usbcore: registered new interface driver hub gitlab # [ 0.075131] usbcore: registered new device driver usb gitlab # [ 0.075439] pps_core: LinuxPPS API ver. 1 registered gitlab # [ 0.075443] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti gitlab # [ 0.075453] PTP clock support registered gitlab # [ 0.075495] EDAC MC: Ver: 3.0.0 gitlab # [ 0.076077] scmi_core: SCMI protocol bus registered gitlab # [ 0.077164] FPGA manager framework gitlab # [ 0.078015] vgaarb: loaded gitlab # [ 0.079899] clocksource: Switched to clocksource arch_sys_counter gitlab # [ 0.097733] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.097815] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.098444] netfs: FS-Cache loaded gitlab # [ 0.098611] pnp: PnP ACPI: disabled gitlab # [ 0.105953] NET: Registered PF_INET protocol family gitlab # [ 0.107106] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.138721] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.138794] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.138866] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.139189] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.139751] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.139961] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.140034] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.140182] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.140416] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.140469] NET: Registered PF_XDP protocol family gitlab # [ 0.140489] PCI: CLS 0 bytes, default 64 gitlab # [ 0.140931] Trying to unpack rootfs image as initramfs... gitlab # [ 0.152206] kvm [1]: HYP mode not available gitlab # [ 0.201457] Initialise system trusted keyrings gitlab # [ 0.201876] workingset: timestamp_bits=42 max_order=21 bucket_order=0 gitlab # [ 0.202735] squashfs: version 4.0 (2009/01/31) Phillip Lougher gitlab # [ 0.202880] 9p: Installing v9fs 9p2000 file system support gitlab # [ 0.214941] Key type asymmetric registered gitlab # [ 0.214949] Asymmetric key parser 'x509' registered gitlab # [ 0.215016] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) gitlab # [ 0.215377] io scheduler mq-deadline registered gitlab # [ 0.215394] io scheduler kyber registered gitlab # [ 0.229255] pl061_gpio 9030000.pl061: PL061 GPIO chip registered gitlab # [ 0.232051] ledtrig-cpu: registered to indicate activity on CPUs gitlab # [ 0.232497] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: gitlab # [ 0.232514] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 gitlab # [ 0.232526] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 gitlab # [ 0.232531] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 gitlab # [ 0.232560] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits gitlab # [ 0.232586] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] gitlab # [ 0.232674] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 gitlab # [ 0.232682] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.232686] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] gitlab # [ 0.232689] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] gitlab # [ 0.232693] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] gitlab # [ 0.232807] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.233368] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.233594] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.233607] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.233633] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.233645] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.234211] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.234451] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.234463] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.234489] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.235054] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.235286] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.235304] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.235330] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.235859] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.236115] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.236127] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.236153] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.236709] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.236932] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.236943] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.236970] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.237552] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.237768] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.237780] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.237806] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.238387] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.238612] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.238624] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.238652] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.238664] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.239213] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint gitlab # [ 0.239436] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.239462] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.240060] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.240275] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.240301] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.240773] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint gitlab # [ 0.240991] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] gitlab # [ 0.241288] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.241579] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] gitlab # [ 0.241597] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.241630] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.242198] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.242417] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.242429] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.242456] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.243105] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned gitlab # [ 0.243112] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned gitlab # [ 0.243116] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned gitlab # [ 0.243162] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned gitlab # [ 0.243212] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned gitlab # [ 0.243263] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned gitlab # [ 0.243314] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned gitlab # [ 0.243362] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned gitlab # [ 0.243412] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned gitlab # [ 0.243463] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned gitlab # [ 0.243514] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned gitlab # [ 0.243565] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned gitlab # [ 0.243630] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned gitlab # [ 0.243681] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned gitlab # [ 0.243703] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned gitlab # [ 0.243727] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned gitlab # [ 0.243750] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned gitlab # [ 0.243771] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned gitlab # [ 0.243789] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned gitlab # [ 0.243811] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned gitlab # [ 0.243835] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned gitlab # [ 0.243854] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned gitlab # [ 0.243873] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned gitlab # [ 0.243912] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned gitlab # [ 0.243938] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned gitlab # [ 0.243957] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned gitlab # [ 0.243975] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned gitlab # [ 0.243996] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned gitlab # [ 0.244019] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned gitlab # [ 0.244042] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned gitlab # [ 0.244065] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned gitlab # [ 0.244088] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned gitlab # [ 0.244108] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned gitlab # [ 0.244127] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned gitlab # [ 0.244153] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] gitlab # [ 0.244159] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] gitlab # [ 0.244162] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] gitlab # [ 0.245606] pci 0000:00:0a.0: enabling device (0000 -> 0002) gitlab # [ 0.282616] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) gitlab # [ 0.288690] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) gitlab # [ 0.295611] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) gitlab # [ 0.301413] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) gitlab # [ 0.307808] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) gitlab # [ 0.315239] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) gitlab # [ 0.321405] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) gitlab # [ 0.328471] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) gitlab # [ 0.334517] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) gitlab # [ 0.340943] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) gitlab # [ 0.348215] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) gitlab # [ 0.364175] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.369401] msm_serial: driver initialized gitlab # [ 0.369869] SuperH (H)SCI(F) driver initialized gitlab # [ 0.370024] STM32 USART driver initialized gitlab # [ 0.420122] loop: module loaded gitlab # [ 0.420765] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 0.426209] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 0.431133] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 0.436357] virtio_blk virtio5: [vdb] 12227528 512-byte logical blocks (6.26 GB/5.83 GiB) gitlab # [ 0.441876] megasas: 07.734.00.00-rc1 gitlab # [ 0.443987] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] gitlab # [ 0.453795] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.453841] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.459402] Using buffer write method gitlab # [ 0.459526] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] gitlab # [ 0.463820] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.463864] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.468605] Using buffer write method gitlab # [ 0.468657] Concatenating MTD devices: gitlab # [ 0.468675] (0): "0.flash" gitlab # [ 0.468684] (1): "0.flash" gitlab # [ 0.468689] into device "0.flash" gitlab # [ 0.795938] Freeing initrd memory: 27184K gitlab # [ 0.814182] tun: Universal TUN/TAP device driver, 1.6 gitlab # [ 0.823560] thunder_xcv, ver 1.0 gitlab # [ 0.823713] thunder_bgx, ver 1.0 gitlab # [ 0.823781] nicpf, ver 1.0 gitlab # [ 0.825834] e1000: Intel(R) PRO/1000 Network Driver gitlab # [ 0.825851] e1000: Copyright (c) 1999-2006 Intel Corporation. gitlab # [ 0.825917] e1000e: Intel(R) PRO/1000 Network Driver gitlab # [ 0.825932] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. gitlab # [ 0.825997] igb: Intel(R) Gigabit Ethernet Network Driver gitlab # [ 0.826007] igb: Copyright (c) 2007-2014 Intel Corporation. gitlab # [ 0.826091] igbvf: Intel(R) Gigabit Virtual Function Network Driver gitlab # [ 0.826103] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. gitlab # [ 0.826535] sky2: driver version 1.30 gitlab # [ 0.832094] usbcore: registered new interface driver usb-storage gitlab # [ 0.832371] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.832424] usbserial: USB Serial support registered for generic gitlab # [ 0.832486] ehci-pci 0000:00:0a.0: EHCI Host Controller gitlab # [ 0.832557] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 gitlab # [ 0.833222] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 gitlab # [ 0.834676] hv_vmbus: registering driver hyperv_keyboard gitlab # [ 0.837641] rtc-pl031 9010000.pl031: registered as rtc0 gitlab # [ 0.837710] rtc-pl031 9010000.pl031: setting system clock to 2026-08-16T17:00:51 UTC (1786899651) gitlab # [ 0.838655] i2c_dev: i2c /dev entries driver gitlab # [ 0.844013] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 gitlab # [ 0.845410] hub 1-0:1.0: USB hub found gitlab # [ 0.845623] hub 1-0:1.0: 6 ports detected gitlab # [ 0.848439] sdhci: Secure Digital Host Controller Interface driver gitlab # [ 0.848456] sdhci: Copyright(c) Pierre Ossman gitlab # [ 0.849390] Synopsys Designware Multimedia Card Interface Driver gitlab # [ 0.850637] sdhci-pltfm: SDHCI platform and OF driver helper gitlab # [ 0.855811] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 0.856850] usbcore: registered new interface driver usbhid gitlab # [ 0.856865] usbhid: USB HID core driver gitlab # [ 0.890416] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available gitlab # [ 0.895822] drop_monitor: Initializing network drop monitor service gitlab # [ 0.896563] NET: Registered PF_INET6 protocol family gitlab # [ 0.899307] Segment Routing with IPv6 gitlab # [ 0.899350] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.899457] NET: Registered PF_PACKET protocol family gitlab # [ 0.899825] 9pnet: Installing 9P2000 support gitlab # [ 0.904391] Key type dns_resolver registered gitlab # [ 0.924637] registered taskstats version 1 gitlab # [ 0.925246] Loading compiled-in X.509 certificates gitlab # [ 0.952892] Demotion targets for Node 0: null gitlab # [ 0.953195] Key type .fscrypt registered gitlab # [ 0.953203] Key type fscrypt-provisioning registered gitlab # [ 0.953456] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 0.953483] ima: Allocated hash algorithm: sha1 gitlab # [ 0.953616] ima: No architecture policies found gitlab # [ 0.955168] input: gpio-keys as /devices/platform/gpio-keys/input/input0 gitlab # [ 0.987059] clk: Disabling unused clocks gitlab # [ 0.987107] PM: genpd: Disabling unused power domains gitlab # [ 0.993058] Freeing unused kernel memory: 4736K gitlab # [ 0.993333] Run /init as init process gitlab # [ 1.027431] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 1.104031] usb 1-1: new high-speed USB device number 2 using ehci-pci gitlab # [ 1.261185] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 gitlab # [ 1.348685] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 gitlab # [ 1.362429] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.362504] systemd[1]: Detected virtualization qemu. gitlab # [ 1.362604] systemd[1]: Detected architecture arm64. gitlab # [ 1.362622] systemd[1]: Running in initrd. gitlab # [ 1.363700] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.364194] systemd[1]: Hostname set to . gitlab # [ 1.468010] usb 1-2: new high-speed USB device number 3 using ehci-pci gitlab # [ 1.620600] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 gitlab # [ 1.621124] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 gitlab # [ 1.649085] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.741662] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.763958] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.764385] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.764435] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.764453] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.764486] systemd[1]: Reached target Path Units. gitlab # [ 1.764507] systemd[1]: Reached target Slice Units. gitlab # [ 1.764534] systemd[1]: Reached target Swaps. gitlab # [ 1.764557] systemd[1]: Reached target Timer Units. gitlab # [ 1.764849] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.765055] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.765250] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.765492] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.765618] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.765690] systemd[1]: Reached target Socket Units. gitlab # [ 1.768535] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.770977] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.771122] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 1.773688] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 1.804132] systemd[1]: Starting Journal Service... gitlab # [ 1.807775] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.808051] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.812097] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 1.814950] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 1.816967] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.817587] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.818009] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 1.820450] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 1.840363] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 1.842453] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.858114] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.858317] systemd-journald[96]: Collecting audit messages is disabled. gitlab # [ 1.858399] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.858429] systemd[1]: Reached target Local File Systems. gitlab # [ 1.863039] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.891146] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 gitlab # [ 1.891347] [drm] features: -virgl +edid -resource_blob -host_visible gitlab # [ 1.891362] [drm] features: -context_init gitlab # [ 1.893079] [drm] number of scanouts: 1 gitlab # [ 1.893111] [drm] number of cap sets: 0 gitlab # [ 1.902394] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 1.903960] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 1.908124] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic gitlab # [ 1.908141] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 gitlab # [ 1.915802] Console: switching to colour frame buffer device 160x50 gitlab # [ 1.916640] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 1.922791] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device gitlab # [ 1.944750] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.948509] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.957322] systemd-modules-load[97]: Using 4 probe threads gitlab # [ 1.958788] systemd-modules-load[97]: Module 'virtio_console' is built in[ 1.964424] systemd[1]: Starting Virtual Console Setup... gitlab # gitlab # [ 1.965083] systemd[1]: Started Journal Service. gitlab # [ 1.966823] systemd-modules-load[97]: Module 'virtio_balloon' is built in gitlab # [ 1.968083] systemd-modules-load[97]: Module 'virtio_rng' is built in gitlab # [ 1.971051] systemd-udevd[102]: Using default interface naming scheme 'v261'. gitlab # [ 1.972978] systemd-modules-load[97]: Inserted module 'dm_mod' gitlab # [ 1.976435] systemd-modules-load[97]: Inserted module 'virtio_gpu' gitlab # [ 1.977794] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.994027] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 2.005588] systemd[1]: Finished Create System Files and Directories. gitlab # [ 2.012706] systemd-vconsole-setup[117]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.016559] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.613553] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 3.098552] EXT4-fs (vda): mounted filesystem 1bb6c3c1-672c-42c6-b01f-2cbb21ba72b4 r/w with ordered data mode. Quota mode: none. gitlab # [ 2.616420] systemd[1]: Reached target System Initialization. gitlab # [ 3.241585] systemd[1]: Reached target Basic System. gitlab # [ 3.242995] (udev-worker)[133]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 3.244500] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 3.246534] (udev-worker)[114]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 3.248966] (udev-worker)[114]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 3.250331] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 3.251324] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 3.252325] systemd[1]: Reached target Initrd Root Device. gitlab # [ 3.253210] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 3.254321] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 3.255283] systemd[1]: Mounting /sysroot... gitlab # [ 3.255909] systemd[1]: Mounted /sysroot. gitlab # [ 3.256616] systemd[1]: Reached target Initrd Root File System. gitlab # [ 3.257448] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.258220] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.258983] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.259644] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.260421] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.261129] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 3.263400] systemd-sysroot-fstab-check[162]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 3.265006] systemd[1]: Reload requested from client PID 162 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 3.266526] systemd[1]: Reloading... gitlab # [ 3.276129] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 3.344547] systemd[1]: Reloading finished in 203 ms. gitlab # [ 3.391368] systemd-sysroot-fstab-check[162]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.394020] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.394870] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 3.395647] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.396343] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.397095] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.400213] systemd-sysroot-fstab-check[162]: Requesting swap.target/start/replace... gitlab # [ 3.409019] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.410112] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.411102] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.412158] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.427677] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.429115] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.543915] (udev-worker)[144]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory gitlab # [ 3.547570] (udev-worker)[144]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory gitlab # [ 3.553181] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.554577] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.555698] systemd[1]: Stopping Virtual Console Setup... gitlab # [ 3.556612] systemd[1]: Starting Virtual Console Setup... gitlab # [ 3.576988] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.578222] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.578982] systemd[1]: Starting Virtual Console Setup... gitlab # [ 3.604785] systemd-vconsole-setup[193]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 3.606813] systemd[1]: Finished Virtual Console Setup. gitlab # [ 3.820220] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.907621] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.910424] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.915501] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.920287] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.977239] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.982852] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully. gitlab # [ 4.007469] systemd[1]: Finished Find NixOS closure. gitlab # [ 4.010007] systemd[1]: Reached target Initrd Default Target. gitlab # [ 4.012585] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 4.093751] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 4.096599] systemd[1]: Stopped target Basic System. gitlab # [ 4.098788] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 4.101319] systemd[1]: Stopped target Path Units. gitlab # [ 4.103463] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 4.106875] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 4.110253] systemd[1]: Stopped target Slice Units. gitlab # [ 4.112493] systemd[1]: Stopped target Socket Units. gitlab # [ 4.114647] systemd[1]: Stopped target System Initialization. gitlab # [ 4.117214] systemd[1]: Stopped target Swaps. gitlab # [ 4.119186] systemd[1]: Stopped target Timer Units. gitlab # [ 4.124609] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 4.127116] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 4.129844] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 4.133089] systemd[1]: Stopped Find NixOS closure. gitlab # [ 4.135237] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 4.138057] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 4.140862] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 4.144275] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 4.146826] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 4.149886] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 4.151879] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 4.155137] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 4.157995] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 4.160666] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 4.163812] systemd[1]: Stopped target Local File Systems. gitlab # [ 4.165884] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 4.168150] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 4.170502] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 4.172425] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 4.174822] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 4.177298] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 4.179059] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 4.181450] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 4.183654] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 4.186100] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.187949] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 4.190168] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 4.192139] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 4.194158] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 4.196341] systemd[1]: systemd-udevd.service: Consumed 2.575s CPU time over 2.303s wall clock time, 31.1M memory peak. gitlab # [ 4.199417] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 4.201730] systemd[1]: Closed udev Control Socket. gitlab # [ 4.203344] systemd[1]: Starting Cleanup udev Database... gitlab # [ 4.205389] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 4.207573] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 4.209489] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 4.211649] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 4.213661] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 4.215394] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.284188] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.287430] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.289886] systemd[1]: Reached target Switch Root. gitlab # [ 4.292044] systemd[1]: Starting NixOS Activation... gitlab # [ 4.493219] initrd-nixos-activation-start[220]: booting system configuration /nix/store/4cz564bp70gwwkqhzfnzcvrknb17cnh9-nixos-system-gitlab-test gitlab # [ 4.566165] initrd-nixos-activation-start[220]: running activation script... gitlab # [ 4.953450] initrd-nixos-activation-start[243]: setting up /etc... gitlab # [ 5.171760] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 5.175716] systemd[1]: Finished NixOS Activation. gitlab # [ 5.180402] systemd[1]: Starting Switch Root... gitlab # [ 5.265193] systemd[1]: Switching root. gitlab # [ 5.417655] systemd-journald[96]: Received SIGTERM from PID 1 (systemd). gitlab # [ 6.180659] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 6.180858] systemd[1]: Detected virtualization qemu. gitlab # [ 6.181192] systemd[1]: Detected architecture arm64. gitlab # [ 6.181648] systemd[1]: Detected first boot. gitlab # [ 6.185520] systemd[1]: Initializing machine ID from random generator. gitlab # [ 6.538121] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 6.673576] systemd[1]: Applying preset policy. gitlab # [ 6.874286] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 7.031584] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 7.032119] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 7.034854] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 7.040620] systemd[1]: Created slice Slice /system/getty. gitlab # [ 7.049640] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 7.053744] systemd[1]: Created slice User and Session Slice. gitlab # [ 7.058212] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 7.059969] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 7.061329] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 7.062569] systemd[1]: Expecting device /dev/ttyAMA0... gitlab # [ 7.063861] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 7.065276] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 7.066534] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 7.067808] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 7.069147] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 7.070516] systemd[1]: Reached target Path Units. gitlab # [ 7.071797] systemd[1]: Reached target Remote File Systems. gitlab # [ 7.073112] systemd[1]: Reached target Slice Units. gitlab # [ 7.074369] systemd[1]: Reached target Swaps. gitlab # [ 7.078924] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 7.083708] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 7.087144] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 7.091089] systemd[1]: Listening on Factory Reset Management. gitlab # [ 7.092510] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 7.102615] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 7.104673] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 7.108328] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 7.109723] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 7.110715] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.111582] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 7.116925] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 7.118152] systemd[1]: Listening on udev Control Socket. gitlab # [ 7.119337] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 7.161540] systemd[1]: Mounting Huge Pages File System... gitlab # [ 7.167826] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 7.175661] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 7.184267] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 7.192585] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 7.200522] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 7.202367] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 7.221004] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 7.224228] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 7.225353] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 7.239194] systemd[1]: Starting Load Kernel Module fuse... gitlab # [ 7.240357] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 7.252836] systemd[1]: Starting Journal Service... gitlab # [ 7.258611] systemd[1]: Starting Load Kernel Modules... gitlab # [ 7.270876] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 7.281729] fuse: init (API version 7.45) gitlab # [ 7.285076] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 7.288797] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.294233] systemd-journald[314]: Collecting audit messages is enabled. gitlab # [ 7.300439] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 7.313733] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 7.314822] systemd[1]: Mounted Huge Pages File System. gitlab # [ 7.316047] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 7.316917] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 7.324739] systemd[1]: Started Journal Service. gitlab # [ 7.320572] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 7.327062] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 7.328359] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 7.329963] systemd-modules-load[315]: Using 3 probe threads gitlab # [ 7.331037] systemd-modules-load[315]: Module 'atkbd' is built in gitlab # [ 7.332154] systemd-modules-load[315]: Module 'loop' is built in gitlab # [ 7.333261] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 7.334291] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 7.335593] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 7.336972] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 7.338755] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 7.339839] systemd[1]: modprobe@fuse.service: Deactivated successfully. gitlab # [ 7.341028] systemd[1]: Finished Load Kernel Module fuse. gitlab # [ 7.341933] systemd-modules-load[315]: Inserted module 'tls' gitlab # [ 7.342805] systemd[1]: Finished Load Kernel Modules. gitlab # [ 7.348081] EXT4-fs (vda): re-mounted 1bb6c3c1-672c-42c6-b01f-2cbb21ba72b4. gitlab # [ 7.346639] systemd[1]: Mounting FUSE Control File System... gitlab # [ 7.353007] systemd[1]: Starting Firewall... gitlab # [ 7.355947] systemd-oomd[317]: No swap; memory pressure usage will be degraded gitlab # [ 7.361273] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 7.364409] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 7.369181] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 7.371680] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 7.375776] systemd[1]: Mounted FUSE Control File System. gitlab # [ 7.379384] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 7.388776] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 7.390416] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 7.396354] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 7.398918] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.400755] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 7.417835] systemd-journald[314]: Received client request to flush runtime journal. gitlab # [ 7.448749] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 7.452446] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 7.454163] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 7.455059] systemd[1]: Reached target First Boot Complete. gitlab # [ 7.455856] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 7.456840] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 7.457842] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 7.458876] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 7.541193] systemd-udevd[356]: Using default interface naming scheme 'v261'. gitlab # [ 7.578851] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 7.959568] systemd[1]: Finished Firewall. gitlab # [ 7.997439] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 8.036062] systemd[1]: Mounting /run/wrappers... gitlab # [ 8.069751] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 8.076991] systemd[1]: Mounted /run/wrappers. gitlab # [ 8.080932] systemd[1]: Reached target Local File Systems. gitlab # [ 8.083488] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 8.094552] systemd[1]: Starting register-nix-paths.service... gitlab # [ 8.096528] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 8.099327] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 8.119457] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 8.128708] systemd[1]: Starting Create System Files and Directories... gitlab # [ 8.184558] systemd[1]: Finished Create System Files and Directories. gitlab # [ 8.190049] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 8.195686] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 8.229068] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 8.233177] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 8.251106] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 8.254703] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 8.264372] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 8.268362] systemd[1]: Starting Update is Completed... gitlab # [ 8.276392] (udev-worker)[401]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 8.298010] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. gitlab # [ 8.302614] (udev-worker)[474]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 8.308572] (udev-worker)[474]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 8.323437] systemd[1]: Finished Update is Completed. gitlab # [ 8.334797] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 8.337462] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 8.339146] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 8.340558] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 8.342913] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 8.347713] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 8.349525] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 8.421293] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 8.423393] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 8.424611] systemd[1]: suid-sgid-wrappers.service: Consumed 208ms CPU time over 325ms wall clock time, 6.1M memory peak, 1.9M read from disk. gitlab # [ 8.460094] mousedev: PS/2 mouse device common for all mice gitlab # [ 8.666287] systemd[1]: Finished register-nix-paths.service. gitlab # [ 8.668610] systemd[1]: Reached target System Initialization. gitlab # [ 8.670077] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 8.671668] systemd[1]: Started logrotate.timer. gitlab # [ 8.673094] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 8.674169] systemd[1]: Reached target Timer Units. gitlab # [ 8.674965] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 8.675918] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 8.686728] systemd[1]: Starting nixbot CI service socket... gitlab # [ 8.688165] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 8.689454] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 8.690327] systemd[1]: Reached target Socket Units. gitlab # [ 8.692558] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 8.743289] dbus-broker-launch[559]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 8.746634] dbus-broker-launch[559]: NSS returned no entry for 'systemd-timesync' gitlab # [ 8.748515] dbus-broker-launch[559]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 8.750963] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 8.763533] dbus-broker-launch[559]: Ready gitlab # [ 8.765361] systemd[1]: Reached target Basic System. gitlab # [ 8.768414] systemd[1]: Started backdoor.service. gitlab # [ 8.772982] systemd[1]: Starting gitlab-config.service... gitlab # [ 8.793720] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 8.804511] systemd[1]: Starting Logrotate configuration check... gitlab # connecting to host... gitlab # [ 8.811478] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 8.820659] systemd[1]: Starting Post-Boot Actions... gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 8.835221] systemd[1]: Started Reset console on configuration changes. gitlab # [ 8.836977] logrotate[566]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab: connected to guest root shell gitlab # [ 8.838844] logrotate[566]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf gitlab: (connecting took 9.33 seconds) gitlab # [ 8.840117] logrotate[566]: note: 'monthly' overrides previously specified 'weekly' gitlab: (finished: waiting for the VM to finish booting, in 9.33 seconds) gitlab # [ 8.841097] logrotate[566]: Reading state from file: /var/lib/logrotate.status gitlab # [ 8.841983] logrotate[566]: state file /var/lib/logrotate.status does not exist gitlab # [ 8.842932] logrotate[566]: Allocating hash table for state file, size 64 entries gitlab # [ 8.843929] logrotate[566]: Handling 4 logs gitlab # [ 8.848368] logrotate[566]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 8.850654] logrotate[566]: considering log /var/log/btmp gitlab # [ 8.851466] logrotate[566]: Creating new state gitlab # [ 8.852847] logrotate[566]: Now: 2026-08-16 17:00 gitlab # [ 8.853585] logrotate[566]: Last rotated at 2026-08-16 17:00 gitlab # [ 8.854371] logrotate[566]: log does not need rotating (log has already been rotated) gitlab # [ 8.855422] logrotate[566]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 8.858045] logrotate[566]: considering log /var/log/wtmp gitlab # [ 8.860288] logrotate[566]: Creating new state gitlab # [ 8.861635] logrotate[566]: Now: 2026-08-16 17:00 gitlab # [ 8.862363] logrotate[566]: Last rotated at 2026-08-16 17:00 gitlab # [ 8.864337] logrotate[566]: log does not need rotating (log has already been rotated) gitlab # [ 8.865598] logrotate[566]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 8.872269] logrotate[566]: switching euid from 0 to 165 and egid from 0 to 165 (pid 566) gitlab # [ 8.873497] logrotate[566]: considering log /var/gitlab/state/log/*.log gitlab # [ 8.874366] logrotate[566]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 8.875576] logrotate[566]: Creating new state gitlab # [ 8.878578] logrotate[566]: switching euid from 165 to 0 and egid from 165 to 0 (pid 566) gitlab # [ 8.879818] logrotate[566]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 8.885854] logrotate[566]: switching euid from 0 to 60 and egid from 0 to 60 (pid 566) gitlab # [ 8.887132] logrotate[566]: considering log /var/log/nginx/*.log gitlab # [ 8.887941] logrotate[566]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 8.892196] logrotate[566]: Creating new state gitlab # [ 8.892943] logrotate[566]: not running postrotate script, since no logs were rotated gitlab # [ 8.894026] logrotate[566]: switching euid from 60 to 0 and egid from 60 to 0 (pid 566) gitlab # [ 8.900313] systemd[1]: Starting resolvconf update... gitlab # [ 8.901656] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.902857] systemd[1]: Finished Logrotate configuration check. gitlab # [ 8.903924] systemd[1]: Finished Post-Boot Actions. gitlab # [ 8.914140] nsncd[567]: Aug 16 17:00:59.579 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.917802] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 8.919453] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.921647] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.932733] systemd[1]: Starting User Login Management... gitlab # [ 8.981323] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 8.984284] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 8.985285] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 8.986236] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 8.992861] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 8.994209] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 8.996173] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 8.997236] systemd[1]: nscd.service: Consumed 35ms CPU time over 180ms wall clock time, 7.3M memory peak, 5.8M read from disk. gitlab # [ 9.009356] systemd-logind[617]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) gitlab # [ 9.011476] systemd-logind[617]: Watching system buttons on /dev/input/event0 (gpio-keys) gitlab # [ 9.012987] systemd-logind[617]: New seat seat0. gitlab # [ 9.015282] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 9.021492] systemd[1]: Started User Login Management. gitlab # [ 9.042558] systemd[1]: Starting linger-users.service... gitlab # [ 9.044140] systemd[1]: Finished resolvconf update. gitlab # [ 9.045832] systemd[1]: Reached target Preparation for Network. gitlab # [ 9.060641] nsncd[658]: Aug 16 17:00:59.724 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 9.068333] systemd[1]: Starting DHCP Client... gitlab # [ 9.071561] systemd[1]: Starting Address configuration of eth1... gitlab # [ 9.080876] systemd[1]: Starting Extra networking commands.... gitlab # [ 9.083798] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 9.086756] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 9.096519] systemd[1]: Finished linger-users.service. gitlab # [ 9.102529] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 9.103752] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 9.137024] network-addresses-eth1-start[681]: adding address 192.168.1.1/24... done gitlab # [ 9.146434] network-addresses-eth1-start[681]: adding address 2001:db8:1::1/64... done gitlab # [ 9.161896] systemd[1]: Finished Address configuration of eth1. gitlab # [ 9.276289] systemd[1]: Finished Extra networking commands.. gitlab # [ 9.281320] systemd[1]: Reached target Network. gitlab # [ 9.291574] dhcpcd[709]: dhcpcd-10.3.2 starting gitlab # [ 9.292616] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 9.297448] systemd[1]: Starting Nginx Web Server... gitlab # [ 9.304028] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 gitlab # [ 9.303599] dhcpcd[750]: dev: loaded udev gitlab # [ 9.322318] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 9.322780] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 9.324730] systemd[1]: Starting PostgreSQL Server... gitlab # [ 9.330200] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 9.340340] systemd[1]: Starting Permit User Sessions... gitlab # [ 9.384696] systemd[1]: Finished Permit User Sessions. gitlab # [ 9.395046] systemd[1]: Started Getty on tty1. gitlab # [ 9.403504] systemd[1]: Reached target Login Prompts. gitlab # [ 9.436630] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 9.451443] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 9.453035] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 9.454950] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 9.455309] cfg80211: failed to load regulatory.db gitlab # [ 9.519699] nginx-pre-start[773]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok gitlab # [ 9.522421] nginx-pre-start[773]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful gitlab # [ 9.533865] systemd[1]: Started Nginx Web Server. gitlab # [ 9.564726] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 9.566303] dhcpcd[750]: eth0: waiting for carrier gitlab # [ 9.570187] dhcpcd[750]: eth0: carrier acquired gitlab # [ 9.570998] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 9.580242] systemd-logind[617]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 9.581731] dhcpcd[750]: DUID 00:01:00:01:32:14:a9:4c:52:54:00:12:34:56 gitlab # [ 9.582799] systemd[1]: Starting Virtual Console Setup... gitlab # [ 9.583884] dhcpcd[750]: eth0: IAID 00:12:34:56 gitlab # [ 9.584763] dhcpcd[750]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 9.587386] postgresql-pre-start[779]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 9.589893] postgresql-pre-start[779]: This user must also own the server process. gitlab # [ 9.591397] postgresql-pre-start[779]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 9.593019] postgresql-pre-start[779]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 9.594330] postgresql-pre-start[779]: The default text search configuration will be set to "english". gitlab # [ 9.595649] postgresql-pre-start[779]: Data page checksums are enabled. gitlab # [ 9.596645] postgresql-pre-start[779]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 9.598069] postgresql-pre-start[779]: creating subdirectories ... ok gitlab # [ 9.598973] postgresql-pre-start[779]: selecting dynamic shared memory implementation ... posix gitlab # [ 9.645007] postgresql-pre-start[779]: selecting default "max_connections" ... 100 gitlab # [ 9.684671] systemd-vconsole-setup[794]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 9.691110] systemd[1]: Finished Virtual Console Setup. gitlab # [ 9.712230] postgresql-pre-start[779]: selecting default "shared_buffers" ... 128MB gitlab # [ 9.729758] redis-server[787]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 9.731898] redis-server[787]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 9.734804] redis-server[787]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=787, just started gitlab # [ 9.736700] redis-server[787]: Configuration loaded gitlab # [ 9.737665] redis[787]: monotonic clock: ARM CNTVCT @ 1000 ticks/us gitlab # [ 9.738819] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 9.739811] redis[787]: Running mode=standalone, port=0. gitlab # [ 9.740928] redis[787]: Server initialized gitlab # [ 9.741878] redis[787]: Ready to accept connections unix gitlab # [ 9.742925] redis[787]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 10.228366] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 10.229400] postgresql-pre-start[779]: selecting default time zone ... UTC gitlab # [ 10.232120] postgresql-pre-start[779]: creating configuration files ... ok gitlab # [ 10.454860] postgresql-pre-start[779]: running bootstrap script ... ok gitlab # [ 10.482748] gitlab-workhorse[825]: time="2026-08-16T17:01:01Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 10.484715] gitlab-workhorse[825]: time="2026-08-16T17:01:01Z" level=info msg="Using redis/go-redis" gitlab # [ 10.486160] gitlab-workhorse[825]: time="2026-08-16T17:01:01Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 11.158730] postgresql-pre-start[779]: performing post-bootstrap initialization ... ok gitlab # [ 11.446794] dhcpcd[750]: eth0: soliciting an IPv6 router gitlab # [ 11.449806] dhcpcd[750]: eth0: Router Advertisement from fe80::2 gitlab # [ 11.452793] dhcpcd[750]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 11.456186] dhcpcd[750]: eth0: adding route to fec0::/64 gitlab # [ 11.458893] dhcpcd[750]: eth0: adding default route via fe80::2 gitlab # [ 11.481243] postgresql-pre-start[779]: syncing data to disk ... ok gitlab # [ 11.483973] postgresql-pre-start[779]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 11.488221] postgresql-pre-start[779]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 11.495013] postgresql-pre-start[779]: Success. You can now start the database server using: gitlab # [ 11.498663] postgresql-pre-start[779]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 11.526212] dhcpcd[750]: eth0: soliciting a DHCP lease gitlab # [ 11.537046] dhcpcd[750]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 11.560731] dhcpcd[750]: eth0: probing address 10.0.2.15/24 gitlab # [ 11.667007] postgres[851]: [851] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 11.672927] postgres[851]: [851] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 11.676345] postgres[851]: [851] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 11.679864] postgres[851]: [851] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 11.690852] postgres[860]: [860] LOG: database system was shut down at 2026-08-16 17:01:01 GMT gitlab # [ 11.699189] postgres[851]: [851] LOG: database system is ready to accept connections gitlab # [ 11.704816] systemd[1]: Started PostgreSQL Server. gitlab # [ 11.710858] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 12.166938] postgresql-setup-start[871]: CREATE DATABASE gitlab # [ 12.223007] postgresql-setup-start[890]: CREATE ROLE gitlab # [ 12.246077] postgresql-setup-start[892]: ALTER DATABASE gitlab # [ 12.294453] postgresql-setup-start[897]: CREATE ROLE gitlab # [ 12.298830] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 12.301757] systemd[1]: Reached target PostgreSQL. gitlab # [ 12.305813] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 12.393980] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[880]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 12.398455] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[880]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 12.478286] gitlab-postgresql-start[905]: CREATE DATABASE gitlab # [ 12.517060] systemd[1]: Finished gitlab-config.service. gitlab # [ 12.528208] systemd[1]: Started gitaly.service. gitlab # [ 12.534970] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 12.558062] gitlab-postgresql-start[920]: CREATE EXTENSION gitlab # [ 12.698140] gitlab-postgresql-start[925]: CREATE EXTENSION gitlab # [ 12.702965] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 13.345992] gitaly[923]: time="2026-08-16T17:01:04.011Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=923 gitlab # [ 13.351428] gitaly[923]: time="2026-08-16T17:01:04.012Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=923 gitlab # [ 13.353176] gitaly[923]: time="2026-08-16T17:01:04.012Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=923 gitlab # [ 13.355211] gitaly[923]: time="2026-08-16T17:01:04.012Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=923 gitlab # [ 13.357074] gitaly[923]: time="2026-08-16T17:01:04.012Z" level=info msg="Starting Gitaly" pid=923 version= gitlab # [ 13.590724] gitaly[923]: time="2026-08-16T17:01:04.256Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=242 pid=923 gitlab # [ 13.592852] gitaly[923]: time="2026-08-16T17:01:04.256Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=923 gitlab # [ 13.595175] gitaly[923]: time="2026-08-16T17:01:04.257Z" level=info msg="finished initializing command factory" duration_ms=0 pid=923 gitlab # [ 13.597518] gitaly[923]: time="2026-08-16T17:01:04.257Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-923/git-exec-3034779991.d/git pid=923 gitlab # [ 13.599810] gitaly[923]: time="2026-08-16T17:01:04.263Z" level=info msg="finished detecting git version" duration_ms=5 pid=923 gitlab # [ 13.601961] gitaly[923]: time="2026-08-16T17:01:04.263Z" level=info msg="using Git version" pid=923 version=2.53.g gitlab # [ 13.603678] gitaly[923]: time="2026-08-16T17:01:04.264Z" level=info msg="clearing disk cache object folder" pid=923 storage=default gitlab # [ 13.605879] gitaly[923]: time="2026-08-16T17:01:04.264Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache398169986 pid=923 storage=default gitlab # [ 13.608902] gitaly[923]: time="2026-08-16T17:01:04.264Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache398169986 pid=923 storage=default gitlab # [ 13.612224] gitaly[923]: time="2026-08-16T17:01:04.264Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=923 gitlab # [ 13.615321] gitaly[923]: time="2026-08-16T17:01:04.265Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=923 gitlab # [ 13.618719] gitaly[923]: time="2026-08-16T17:01:04.265Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache398169986 clear_duration_ms=0 pid=923 storage=default gitlab # [ 13.631187] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=923 gitlab # [ 13.633902] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=923 schema=unix gitlab # [ 13.636277] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="counting repositories" pid=923 gitlab # [ 13.638892] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="starting to count repositories" pid=923 storage_path=/var/gitlab/state/repositories gitlab # [ 13.641165] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="finished tempdir cleaner walk" pid=923 storage=default time_ms=0 gitlab # [ 13.643148] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="listening at address" address=/run/gitaly/gitaly-923/sock.d/intern pid=923 schema=unix gitlab # [ 13.645606] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=923 storage_path=/var/gitlab/state/repositories gitlab # [ 13.648064] gitaly[923]: time="2026-08-16T17:01:04.297Z" level=info msg="completed counting all repositories" counting_duration=0 pid=923 gitlab # [ 13.650078] gitaly[923]: time="2026-08-16T17:01:04.300Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=923 gitlab # [ 13.652137] gitaly[923]: time="2026-08-16T17:01:04.300Z" level=info msg="Started Gitaly" duration_ms=287 pid=923 gitlab # [ 13.653756] gitaly[923]: time="2026-08-16T17:01:04.300Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=923 gitlab # [ 13.655813] gitaly[923]: time="2026-08-16T17:01:04.300Z" level=info msg="maintenance: daily scheduled" pid=923 scheduled="2026-08-17 12:00:00 +0000 UTC" gitlab # [ 14.058991] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[928]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 14.068796] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[928]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 14.078632] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[928]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 16.970574] dhcpcd[750]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 16.973598] dhcpcd[750]: eth0: adding route to 10.0.2.0/24 gitlab # [ 16.975996] dhcpcd[750]: eth0: adding default route via 10.0.2.2 gitlab # [ 17.152957] systemd[1]: Started DHCP Client. gitlab # [ 17.157302] systemd[1]: Reached target Network is Online. gitlab # [ 17.880590] gitaly[923]: time="2026-08-16T17:01:08.545Z" level=info msg="License database preloaded" duration_ms=4532 pid=923 gitlab # [ 67.614728] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[928]: W, [2026-08-16T17:01:58.280096 #928] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 70.570853] gitlab-workhorse[825]: time="2026-08-16T17:02:01Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 71.006688] postgres[1507]: [1507] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 71.011295] postgres[1507]: [1507] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 71.015489] postgres[1507]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 71.020134] postgres[1507]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 71.023853] postgres[1507]: attidentity AS identity, gitlab # [ 71.026447] postgres[1507]: attgenerated as attgenerated gitlab # [ 71.029118] postgres[1507]: FROM pg_attribute a gitlab # [ 71.031243] postgres[1507]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 71.035219] postgres[1507]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 71.038209] postgres[1507]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 71.042673] postgres[1507]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 71.045694] postgres[1507]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 71.048476] postgres[1507]: ORDER BY a.attnum gitlab # [ 71.050478] postgres[1507]: gitlab # [ 77.500523] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1568]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 77.501162] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1568]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 80.585609] gitlab-workhorse[825]: time="2026-08-16T17:02:11Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 90.586861] gitlab-workhorse[825]: time="2026-08-16T17:02:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 100.597784] gitlab-workhorse[825]: time="2026-08-16T17:02:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 107.487519] postgres[1698]: [1698] ERROR: relation "table_without_models" does not exist gitlab # [ 107.487962] postgres[1698]: [1698] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 110.598804] gitlab-workhorse[825]: time="2026-08-16T17:02:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 120.606675] gitlab-workhorse[825]: time="2026-08-16T17:02:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 130.610671] gitlab-workhorse[825]: time="2026-08-16T17:03:01Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 139.077501] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 139.083783] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 139.089258] systemd[1]: Starting gitlab.service... gitlab # [ 139.702796] bundle[2091]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 139.703362] bundle[2091]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 139.704703] bundle[2091]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 140.613146] gitlab-workhorse[825]: time="2026-08-16T17:03:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 144.937581] sidekiq-cluster[2090]: {"severity":"INFO","time":"2026-08-16T17:03:15.564Z","message":"Starting cluster with 1 processes"} gitlab # [ 145.134156] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.771Z","pid":2091,"message":"* Enabling systemd notification integration"} gitlab # [ 145.139689] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"Puma starting in cluster mode..."} gitlab # [ 145.144262] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 145.148848] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 145.154588] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Min threads: 0"} gitlab # [ 145.158487] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Max threads: 4"} gitlab # [ 145.162923] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Environment: production"} gitlab # [ 145.167407] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Master PID: 2091"} gitlab # [ 145.171778] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Workers: 2"} gitlab # [ 145.175878] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 145.180987] bundle[2091]: {"timestamp":"2026-08-16T17:03:15.799Z","pid":2091,"message":"* Preloading application"} gitlab # [ 150.622371] gitlab-workhorse[825]: time="2026-08-16T17:03:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 160.630841] gitlab-workhorse[825]: time="2026-08-16T17:03:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 170.638613] gitlab-workhorse[825]: time="2026-08-16T17:03:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 180.648303] gitlab-workhorse[825]: time="2026-08-16T17:03:51Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 184.162396] bundle[2091]: W, [2026-08-16T17:03:54.827237 #2091] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 188.721714] sidekiq-cluster[2139]: 2026-08-16T17:03:59.386Z pid=2139 tid=xrn INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2139, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>433049600} gitlab # [ 188.999280] sidekiq-cluster[2139]: W, [2026-08-16T17:03:59.665034 #2139] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 189.066318] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:03:59.732Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 190.658699] gitlab-workhorse[825]: time="2026-08-16T17:04:01Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 193.006273] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.671Z","message":"GitLab reliable fetch activated!"} gitlab # [ 193.006724] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.671Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 193.040396] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.706Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 193.047380] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.709Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 193.054509] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.712Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 193.061086] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.714Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 193.068409] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.717Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 193.075280] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.720Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 193.084775] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.722Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 193.086805] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.724Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 193.088866] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.726Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 193.090874] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.728Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 193.093295] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.730Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 193.095421] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.732Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 193.097550] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.734Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 193.099666] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.736Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 193.101899] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.739Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 193.103982] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.746Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 193.106117] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.750Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 193.108069] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.759Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 193.110190] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.768Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 193.112243] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.774Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 193.115966] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.781Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 193.121807] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.787Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 193.126587] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.792Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 193.131101] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.797Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 193.137390] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.801Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 193.140374] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.806Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 193.144262] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.810Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 193.148259] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.813Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 193.151280] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.817Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 193.154706] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.820Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 193.157780] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.823Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 193.161078] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.827Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 193.163999] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.830Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 193.167002] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.833Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 193.169714] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.835Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 193.171779] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.837Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 193.174137] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.840Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 193.176947] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.843Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 193.178903] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.844Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 193.180931] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.846Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 193.182999] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.848Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 193.185167] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.850Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 193.187273] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.852Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 193.189411] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.854Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 193.191528] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.857Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 193.193892] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.859Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 193.195975] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.860Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 193.198217] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.863Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 193.200256] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.865Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 193.202307] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.867Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 193.204408] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.869Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 193.206423] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.871Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 193.216283] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.882Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 193.218742] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.884Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 193.221028] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.887Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 193.223211] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.889Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 193.225469] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.891Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 193.227692] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.893Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 193.230008] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.895Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 193.232194] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.896Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 193.234160] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.898Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 193.236137] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.900Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 193.238209] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.903Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 193.240370] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.905Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 193.242522] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.907Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 193.244697] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.910Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 193.246660] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.911Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 193.248783] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.913Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 193.250940] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.915Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 193.253192] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.916Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 193.255358] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.918Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 193.257665] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.919Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 193.259808] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.921Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 193.262306] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.923Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 193.264609] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.924Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 193.266844] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.926Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 193.269075] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.928Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 193.271450] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.929Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 193.273699] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.931Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 193.275765] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.933Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 193.278241] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.934Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 193.280635] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.936Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 193.282852] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.938Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 193.285070] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.940Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 193.287262] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.942Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 193.289479] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.944Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 193.291673] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.946Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 193.293980] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.948Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 193.296236] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.949Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 193.298421] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.951Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 193.300693] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.953Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 193.302846] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.954Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 193.305151] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.956Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 193.307502] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.958Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 193.309588] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.960Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 193.311862] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.963Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 193.314240] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.964Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 193.316466] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.966Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 193.318626] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.977Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 193.320888] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.979Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 193.322996] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.981Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 193.325295] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.984Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 193.327225] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.986Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 193.329412] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.989Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 193.331629] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.991Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 193.334010] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:03.993Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 193.370825] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:04.035Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 193.374071] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:04.040Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 193.376597] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:04.041Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 200.666300] gitlab-workhorse[825]: time="2026-08-16T17:04:11Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 210.672711] gitlab-workhorse[825]: time="2026-08-16T17:04:21Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 220.674360] gitlab-workhorse[825]: time="2026-08-16T17:04:31Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 230.682251] gitlab-workhorse[825]: time="2026-08-16T17:04:41Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 233.368271] postgres[2885]: [2885] ERROR: relation "table_without_models" does not exist gitlab # [ 233.371779] postgres[2885]: [2885] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 234.499820] postgres[2896]: [2896] ERROR: relation "table_without_models" does not exist gitlab # [ 234.503569] postgres[2896]: [2896] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 238.325562] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:48.990Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 238.332997] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:48.998Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 238.339267] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:48.999Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 238.344826] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:48.999Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 238.350850] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:49.000Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 240.220374] bundle[2091]: {"timestamp":"2026-08-16T17:04:50.885Z","pid":2091,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 240.220709] bundle[2091]: {"timestamp":"2026-08-16T17:04:50.885Z","pid":2091,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 240.220900] bundle[2091]: {"timestamp":"2026-08-16T17:04:50.885Z","pid":2091,"message":"! #\u003cThread:0x0000ebb3dee85520 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 240.221068] bundle[2091]: {"timestamp":"2026-08-16T17:04:50.885Z","pid":2091,"message":"! #\u003cThread:0x0000ebb3dcd915d0 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 240.221174] bundle[2091]: {"timestamp":"2026-08-16T17:04:50.885Z","pid":2091,"message":"Use Ctrl-C to stop"} gitlab # [ 240.221289] bundle[2091]: {"timestamp":"2026-08-16T17:04:50.886Z","pid":2091,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 241.027294] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:51.692Z","message":"Cleaning working queues"} gitlab # [ 241.036595] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:51.701Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4620f6c4d510d15de69ef7e7","created_at":"2026-08-16T17:03:09.156Z","trace_propagation_headers":{"sentry-trace":"77ea771926b942ffab8f1c6427643b5a-eb4edbcab63b43ca","baggage":"sentry-trace_id=77ea771926b942ffab8f1c6427643b5a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ed71247dba7f4083f3b7f4537d14d99d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:03:09.168Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4620f6c4d510d15de69ef7e7: start","job_status":"start","queue_duration_s":102.532972,"scheduling_latency_s":102.533079} gitlab # [ 241.073142] bundle[2091]: {"timestamp":"2026-08-16T17:04:51.709Z","pid":2091,"message":"- Worker 0 (PID: 2998) booted in 0.72s, phase: 0"} gitlab # [ 241.075584] bundle[2091]: {"timestamp":"2026-08-16T17:04:51.727Z","pid":2091,"message":"- Worker 1 (PID: 3002) booted in 0.7s, phase: 0"} gitlab # [ 241.077603] systemd[1]: Started gitlab.service. gitlab # [ 241.078350] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 241.079339] systemd[1]: Starting setup-gitlab.service... gitlab # [ 241.104487] setup-gitlab-start[3033]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 241.252125] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:04:51.914Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"4620f6c4d510d15de69ef7e7","created_at":"2026-08-16T17:03:09.156Z","trace_propagation_headers":{"sentry-trace":"77ea771926b942ffab8f1c6427643b5a-eb4edbcab63b43ca","baggage":"sentry-trace_id=77ea771926b942ffab8f1c6427643b5a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"ed71247dba7f4083f3b7f4537d14d99d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:03:09.168Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-4620f6c4d510d15de69ef7e7: done: 0.213638 sec","job_status":"done","queue_duration_s":102.532972,"scheduling_latency_s":102.533079,"redis_calls":24,"redis_duration_s":0.0058449999999999995,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.002263,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002674,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097619,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10743552,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.213638,"completed_at":"2026-08-16T17:04:51.914Z","load_balancing_strategy":"primary","db_duration_s":0.052816,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 244.548053] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:04:55 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 3418 gitlab # [ 244.552064] setup-gitlab-start[3033]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 244.553890] setup-gitlab-start[3033]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 244.570135] runuser[3063]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 245.135739] setup-gitlab-start[3064]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 245.142443] setup-gitlab-start[3064]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 245.148765] setup-gitlab-start[3064]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 245.963472] setup-gitlab-start[3064]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 245.963801] setup-gitlab-start[3064]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 245.966162] setup-gitlab-start[3064]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 254.977947] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:05.639Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"92690fc57d4d4f2d7d45c497","created_at":"2026-08-16T17:05:05.480Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"404b1a1ae2bf286263042449e2b3204d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.632Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-92690fc57d4d4f2d7d45c497: start","job_status":"start","queue_duration_s":0.006877,"scheduling_latency_s":0.006947} gitlab # [ 255.419434] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:06.084Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 255.567507] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:06.231Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"92690fc57d4d4f2d7d45c497","created_at":"2026-08-16T17:05:05.480Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"404b1a1ae2bf286263042449e2b3204d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.632Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-92690fc57d4d4f2d7d45c497: done: 0.591977 sec","job_status":"done","queue_duration_s":0.006877,"scheduling_latency_s":0.006947,"redis_calls":10,"redis_duration_s":0.027338,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.009652,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012906,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00478,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08498,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00389034,"duration_s":0.591977,"completed_at":"2026-08-16T17:05:06.231Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.134916,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 255.670991] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:06.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6ac9d78385a25834609ddf7d","created_at":"2026-08-16T17:05:05.692Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90cb41712a4f85104bfcaee1026e5358","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:05:05.724Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6ac9d78385a25834609ddf7d: start","job_status":"start","queue_duration_s":0.579755,"scheduling_latency_s":0.580055} gitlab # [ 255.998571] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:06.660Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6ac9d78385a25834609ddf7d","created_at":"2026-08-16T17:05:05.692Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90cb41712a4f85104bfcaee1026e5358","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:05:05.724Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6ac9d78385a25834609ddf7d: done: 0.35596 sec","job_status":"done","queue_duration_s":0.579755,"scheduling_latency_s":0.580055,"redis_calls":10,"redis_duration_s":0.021741,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002766,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015083,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003892,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.058,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.058,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.120953,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00782404,"duration_s":0.35596,"completed_at":"2026-08-16T17:05:06.659Z","load_balancing_strategy":"primary","db_duration_s":0.082122,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.089023] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:06.674Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"32b2e8c601a028472484f98b","created_at":"2026-08-16T17:05:05.801Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5e7dd4cbeac8f43d493bbeff30a93de","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.833Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-32b2e8c601a028472484f98b: start","job_status":"start","queue_duration_s":0.840953,"scheduling_latency_s":0.841023} gitlab # [ 256.434738] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.098Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"32b2e8c601a028472484f98b","created_at":"2026-08-16T17:05:05.801Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e5e7dd4cbeac8f43d493bbeff30a93de","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.833Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-32b2e8c601a028472484f98b: done: 0.423503 sec","job_status":"done","queue_duration_s":0.840953,"scheduling_latency_s":0.841023,"redis_calls":10,"redis_duration_s":0.026865,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005454,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.097664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00767968,"duration_s":0.423503,"completed_at":"2026-08-16T17:05:07.097Z","load_balancing_strategy":"primary","db_duration_s":0.115095,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.537442] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.115Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c162b9d2feb32b709c1f9ab3","created_at":"2026-08-16T17:05:05.917Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe63b18b606c1afd223b323eb72959de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.935Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c162b9d2feb32b709c1f9ab3: start","job_status":"start","queue_duration_s":1.180234,"scheduling_latency_s":1.180473} gitlab # [ 256.824900] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c162b9d2feb32b709c1f9ab3","created_at":"2026-08-16T17:05:05.917Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe63b18b606c1afd223b323eb72959de","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:05.935Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c162b9d2feb32b709c1f9ab3: done: 0.373763 sec","job_status":"done","queue_duration_s":1.180234,"scheduling_latency_s":1.180473,"redis_calls":12,"redis_duration_s":0.07175999999999999,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.017308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.035722,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.01873,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.110795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.01378264,"exclusive_lock_hold_duration_s":0.06284796000000001,"duration_s":0.373763,"completed_at":"2026-08-16T17:05:07.489Z","load_balancing_strategy":"primary","db_duration_s":0.047014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 256.918757] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1a11e4d67b9db15ae2c5339b","created_at":"2026-08-16T17:05:06.037Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20c6e8a7e9911f0e294db8127773b6b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.094Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1a11e4d67b9db15ae2c5339b: start","job_status":"start","queue_duration_s":1.402823,"scheduling_latency_s":1.402881} gitlab # [ 257.009612] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.670Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"1a11e4d67b9db15ae2c5339b","created_at":"2026-08-16T17:05:06.037Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"20c6e8a7e9911f0e294db8127773b6b1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.094Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-1a11e4d67b9db15ae2c5339b: done: 0.173504 sec","job_status":"done","queue_duration_s":1.402823,"scheduling_latency_s":1.402881,"redis_calls":12,"redis_duration_s":0.016338,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00136,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005041,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.009937,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.041,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.041,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00175398,"duration_s":0.173504,"completed_at":"2026-08-16T17:05:07.670Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.082930] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"eb1aa2a58672c957545207e4","created_at":"2026-08-16T17:05:06.206Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"961689ec4788bb342ab118f49c9a8b57","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.235Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-eb1aa2a58672c957545207e4: start","job_status":"start","queue_duration_s":1.448441,"scheduling_latency_s":1.448504} gitlab # [ 257.187195] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.852Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 257.264556] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.929Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"eb1aa2a58672c957545207e4","created_at":"2026-08-16T17:05:06.206Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"961689ec4788bb342ab118f49c9a8b57","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.235Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-eb1aa2a58672c957545207e4: done: 0.2443 sec","job_status":"done","queue_duration_s":1.448441,"scheduling_latency_s":1.448504,"redis_calls":10,"redis_duration_s":0.060951000000000005,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.007505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.01785,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.035596,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.06812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00268306,"duration_s":0.2443,"completed_at":"2026-08-16T17:05:07.928Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.364988] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:07.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0525dfa91925aecd579abab1","created_at":"2026-08-16T17:05:06.373Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"238cae289a5fa1afe3648a8ce244e0c8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.430Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0525dfa91925aecd579abab1: start","job_status":"start","queue_duration_s":1.515239,"scheduling_latency_s":1.5153} gitlab # [ 257.434607] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.098Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"0525dfa91925aecd579abab1","created_at":"2026-08-16T17:05:06.373Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"238cae289a5fa1afe3648a8ce244e0c8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.430Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-0525dfa91925aecd579abab1: done: 0.15297 sec","job_status":"done","queue_duration_s":1.515239,"scheduling_latency_s":1.5153,"redis_calls":10,"redis_duration_s":0.0069619999999999994,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001289,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004227,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001446,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.077546,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0010227,"duration_s":0.15297,"completed_at":"2026-08-16T17:05:08.098Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.522538] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"94a29c2708688e5aee4d32e4","created_at":"2026-08-16T17:05:06.468Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fd75dc18420dbae3e88091aec0088c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.527Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-94a29c2708688e5aee4d32e4: start","job_status":"start","queue_duration_s":1.576248,"scheduling_latency_s":1.576284} gitlab # [ 257.895510] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.557Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"94a29c2708688e5aee4d32e4","created_at":"2026-08-16T17:05:06.468Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fd75dc18420dbae3e88091aec0088c2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.527Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-94a29c2708688e5aee4d32e4: done: 0.453957 sec","job_status":"done","queue_duration_s":1.576248,"scheduling_latency_s":1.576284,"redis_calls":14,"redis_duration_s":0.007821999999999999,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002395,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00325,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002177,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.087,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.084,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.326423,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00159434,"exclusive_lock_hold_duration_s":0.38178378,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.453957,"completed_at":"2026-08-16T17:05:08.557Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.117162,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 257.998286] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.561Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"eb860c0688df5581eeee2300","created_at":"2026-08-16T17:05:06.573Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41b1a9335f3471df1502395afadb9f25","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.610Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-eb860c0688df5581eeee2300: start","job_status":"start","queue_duration_s":1.95076,"scheduling_latency_s":1.950812} gitlab # [ 258.017637] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.625Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"eb860c0688df5581eeee2300","created_at":"2026-08-16T17:05:06.573Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"41b1a9335f3471df1502395afadb9f25","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.610Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-eb860c0688df5581eeee2300: done: 0.064199 sec","job_status":"done","queue_duration_s":1.95076,"scheduling_latency_s":1.950812,"redis_calls":17,"redis_duration_s":0.005784,"redis_read_bytes":15,"redis_write_bytes":2007,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002981,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1150,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00048,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000609,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054114,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.064199,"completed_at":"2026-08-16T17:05:08.625Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.063930] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.628Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"affad6467eb2da9fc121d05a","created_at":"2026-08-16T17:05:06.654Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.698Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-affad6467eb2da9fc121d05a: start","job_status":"start","queue_duration_s":1.930365,"scheduling_latency_s":1.9304} gitlab # [ 258.077443] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.689Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"affad6467eb2da9fc121d05a","created_at":"2026-08-16T17:05:06.654Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.698Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-affad6467eb2da9fc121d05a: done: 0.061369 sec","job_status":"done","queue_duration_s":1.930365,"scheduling_latency_s":1.9304,"redis_calls":19,"redis_duration_s":0.004680999999999999,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001005,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000406,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002508,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000762,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043918,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036804,"duration_s":0.061369,"completed_at":"2026-08-16T17:05:08.689Z","load_balancing_strategy":"primary","db_duration_s":0.004171,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.120324] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.692Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4ae241c01e5b1a36d5542c49","created_at":"2026-08-16T17:05:06.756Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"003ad569740196713259b624c7feb9f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.797Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4ae241c01e5b1a36d5542c49: start","job_status":"start","queue_duration_s":1.89434,"scheduling_latency_s":1.894368} gitlab # [ 258.134494] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.707Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 258.137946] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.716Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4ae241c01e5b1a36d5542c49","created_at":"2026-08-16T17:05:06.756Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"003ad569740196713259b624c7feb9f1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.797Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4ae241c01e5b1a36d5542c49: done: 0.024221 sec","job_status":"done","queue_duration_s":1.89434,"scheduling_latency_s":1.894368,"redis_calls":10,"redis_duration_s":0.001756,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000387,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001019,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00035,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014387,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032712,"duration_s":0.024221,"completed_at":"2026-08-16T17:05:08.716Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000603,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.181199] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.717Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ceca84eaeb740c94fd5ff8c7","created_at":"2026-08-16T17:05:06.873Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1a27086d13c2267fa17b42098bec5ea","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.936Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ceca84eaeb740c94fd5ff8c7: start","job_status":"start","queue_duration_s":1.781528,"scheduling_latency_s":1.78155} gitlab # [ 258.195763] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.757Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"ceca84eaeb740c94fd5ff8c7","created_at":"2026-08-16T17:05:06.873Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1a27086d13c2267fa17b42098bec5ea","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:06.936Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-ceca84eaeb740c94fd5ff8c7: done: 0.039397 sec","job_status":"done","queue_duration_s":1.781528,"scheduling_latency_s":1.78155,"redis_calls":13,"redis_duration_s":0.002228,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00035,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001129,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.012565999999999999,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.039397,"completed_at":"2026-08-16T17:05:08.757Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004926,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 258.240112] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.758Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0482c20fc1d3256f9b35ee11","created_at":"2026-08-16T17:05:07.088Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.128Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0482c20fc1d3256f9b35ee11: start","job_status":"start","queue_duration_s":1.629671,"scheduling_latency_s":1.629692} gitlab # [ 258.253437] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.873Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"0482c20fc1d3256f9b35ee11","created_at":"2026-08-16T17:05:07.088Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.128Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-0482c20fc1d3256f9b35ee11: done: 0.114806 sec","job_status":"done","queue_duration_s":1.629671,"scheduling_latency_s":1.629692,"redis_calls":71,"redis_duration_s":0.010968,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.00141,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000787,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.008337,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000434,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.101244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025186,"duration_s":0.114806,"completed_at":"2026-08-16T17:05:08.873Z","load_balancing_strategy":"primary","db_duration_s":0.002697,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.296085] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.874Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"3929a7cb87f524225764303d","created_at":"2026-08-16T17:05:07.146Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40bf662c4370e8865d7c642f3f357bd9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.174Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-3929a7cb87f524225764303d: start","job_status":"start","queue_duration_s":1.700421,"scheduling_latency_s":1.700439} gitlab # [ 258.310367] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.886Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 258.314176] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.903Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"3929a7cb87f524225764303d","created_at":"2026-08-16T17:05:07.146Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"40bf662c4370e8865d7c642f3f357bd9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.174Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-3929a7cb87f524225764303d: done: 0.028432 sec","job_status":"done","queue_duration_s":1.700421,"scheduling_latency_s":1.700439,"redis_calls":10,"redis_duration_s":0.002082,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000278,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001298,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000506,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00061946,"duration_s":0.028432,"completed_at":"2026-08-16T17:05:08.902Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000625,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.357318] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.907Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"47da907f5749f2fd5f9bad86","created_at":"2026-08-16T17:05:07.249Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14216ee33a86f5f77a05f0f09d5ff903","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.318Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-47da907f5749f2fd5f9bad86: start","job_status":"start","queue_duration_s":1.588715,"scheduling_latency_s":1.588762} gitlab # [ 258.371371] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.976Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"47da907f5749f2fd5f9bad86","created_at":"2026-08-16T17:05:07.249Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14216ee33a86f5f77a05f0f09d5ff903","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.318Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-47da907f5749f2fd5f9bad86: done: 0.069196 sec","job_status":"done","queue_duration_s":1.588715,"scheduling_latency_s":1.588762,"redis_calls":10,"redis_duration_s":0.003565,"redis_read_bytes":9,"redis_write_bytes":1109,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000585,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002221,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000759,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00089288,"duration_s":0.069196,"completed_at":"2026-08-16T17:05:08.976Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013431,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.413330] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:08.979Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2ad225abb24dc8a8eaf885e5","created_at":"2026-08-16T17:05:07.359Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cab2dfc7e41944c4846cb34086dff20d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:05:07.397Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2ad225abb24dc8a8eaf885e5: start","job_status":"start","queue_duration_s":1.582334,"scheduling_latency_s":1.582374} gitlab # [ 258.426444] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.004Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 258.429818] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.019Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"2ad225abb24dc8a8eaf885e5","created_at":"2026-08-16T17:05:07.359Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cab2dfc7e41944c4846cb34086dff20d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:05:07.397Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-2ad225abb24dc8a8eaf885e5: done: 0.040269 sec","job_status":"done","queue_duration_s":1.582334,"scheduling_latency_s":1.582374,"redis_calls":10,"redis_duration_s":0.003591,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000928,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002003,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00066,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057506,"duration_s":0.040269,"completed_at":"2026-08-16T17:05:09.019Z","load_balancing_strategy":"primary","db_duration_s":0.000821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.470602] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.022Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a87d9e46f430136edfb799d5","created_at":"2026-08-16T17:05:07.467Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75f1df41ee36219a2298e0e6bdd2f3a3","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.503Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a87d9e46f430136edfb799d5: start","job_status":"start","queue_duration_s":1.51855,"scheduling_latency_s":1.518582} gitlab # [ 258.485076] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.060Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a87d9e46f430136edfb799d5","created_at":"2026-08-16T17:05:07.467Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75f1df41ee36219a2298e0e6bdd2f3a3","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.503Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a87d9e46f430136edfb799d5: done: 0.038452 sec","job_status":"done","queue_duration_s":1.51855,"scheduling_latency_s":1.518582,"redis_calls":12,"redis_duration_s":0.004562999999999999,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000566,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002217,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00178,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00073438,"exclusive_lock_hold_duration_s":0.00532522,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.038452,"completed_at":"2026-08-16T17:05:09.060Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002718,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 258.528120] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.063Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"41017cd7a0486ca39b07b3f3","created_at":"2026-08-16T17:05:07.523Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f9e0a9015d006c107d612a8e89b52b1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.562Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-41017cd7a0486ca39b07b3f3: start","job_status":"start","queue_duration_s":1.500746,"scheduling_latency_s":1.500772} gitlab # [ 258.918520] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"41017cd7a0486ca39b07b3f3","created_at":"2026-08-16T17:05:07.523Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f9e0a9015d006c107d612a8e89b52b1","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.562Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-41017cd7a0486ca39b07b3f3: done: 0.520899 sec","job_status":"done","queue_duration_s":1.500746,"scheduling_latency_s":1.500772,"redis_calls":565,"redis_duration_s":0.129173,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000541,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001581,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.127051,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.441335,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039194,"duration_s":0.520899,"completed_at":"2026-08-16T17:05:09.583Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000713,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.029590] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d307f7e2e07a7811e264a69a","created_at":"2026-08-16T17:05:07.594Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eecf427cd1935af95acceb0164fb6ab1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.619Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d307f7e2e07a7811e264a69a: start","job_status":"start","queue_duration_s":1.966493,"scheduling_latency_s":1.96652} gitlab # [ 259.055069] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.609Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"d307f7e2e07a7811e264a69a","created_at":"2026-08-16T17:05:07.594Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"eecf427cd1935af95acceb0164fb6ab1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.619Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-d307f7e2e07a7811e264a69a: done: 0.023417 sec","job_status":"done","queue_duration_s":1.966493,"scheduling_latency_s":1.96652,"redis_calls":10,"redis_duration_s":0.002474,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000508,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001445,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013145,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003381,"duration_s":0.023417,"completed_at":"2026-08-16T17:05:09.609Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000849,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.111386] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.611Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"397ba1d27924c44a89b02e33","created_at":"2026-08-16T17:05:07.664Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d35cf4ad61681f02d003e166c0bddb2c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.700Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-397ba1d27924c44a89b02e33: start","job_status":"start","queue_duration_s":1.910802,"scheduling_latency_s":1.910822} gitlab # [ 259.125994] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"397ba1d27924c44a89b02e33","created_at":"2026-08-16T17:05:07.664Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d35cf4ad61681f02d003e166c0bddb2c","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.700Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-397ba1d27924c44a89b02e33: done: 0.06143 sec","job_status":"done","queue_duration_s":1.910802,"scheduling_latency_s":1.910822,"redis_calls":10,"redis_duration_s":0.003272,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000543,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00221,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000519,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039272,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.06143,"completed_at":"2026-08-16T17:05:09.672Z","load_balancing_strategy":"primary","db_duration_s":0.033092,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.168309] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.676Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8b795ab0c13ef0e7d854c628","created_at":"2026-08-16T17:05:07.711Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edf35e30af1937a2b93268f2151968d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.733Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8b795ab0c13ef0e7d854c628: start","job_status":"start","queue_duration_s":1.943233,"scheduling_latency_s":1.943287} gitlab # [ 259.182384] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.766Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"8b795ab0c13ef0e7d854c628","created_at":"2026-08-16T17:05:07.711Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edf35e30af1937a2b93268f2151968d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.733Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-8b795ab0c13ef0e7d854c628: done: 0.090251 sec","job_status":"done","queue_duration_s":1.943233,"scheduling_latency_s":1.943287,"redis_calls":12,"redis_duration_s":0.004778,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000871,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001736,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00124486,"exclusive_lock_hold_duration_s":0.0394885,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.090251,"completed_at":"2026-08-16T17:05:09.766Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015398,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.227980] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.768Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"11154433dcba2be101a42524","created_at":"2026-08-16T17:05:07.801Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76ab99c45bb1a3a9afc938a8864f542a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:05:07.857Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-11154433dcba2be101a42524: start","job_status":"start","queue_duration_s":1.911566,"scheduling_latency_s":1.911599} gitlab # [ 259.241352] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.788Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 259.244868] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"11154433dcba2be101a42524","created_at":"2026-08-16T17:05:07.801Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"76ab99c45bb1a3a9afc938a8864f542a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:05:07.857Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-11154433dcba2be101a42524: done: 0.03068 sec","job_status":"done","queue_duration_s":1.911566,"scheduling_latency_s":1.911599,"redis_calls":10,"redis_duration_s":0.002833,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000589,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000567,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004356,"duration_s":0.03068,"completed_at":"2026-08-16T17:05:09.799Z","load_balancing_strategy":"primary","db_duration_s":0.000742,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.285824] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.801Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"35e315751fcd0aad500bd85a","created_at":"2026-08-16T17:05:07.906Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a1dc760537ec1041504f2828bd40ce0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.942Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-35e315751fcd0aad500bd85a: start","job_status":"start","queue_duration_s":1.859596,"scheduling_latency_s":1.859625} gitlab # [ 259.300343] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.871Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"35e315751fcd0aad500bd85a","created_at":"2026-08-16T17:05:07.906Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6a1dc760537ec1041504f2828bd40ce0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:05:07.942Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-35e315751fcd0aad500bd85a: done: 0.069686 sec","job_status":"done","queue_duration_s":1.859596,"scheduling_latency_s":1.859625,"redis_calls":12,"redis_duration_s":0.004109,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000579,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001622,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00093216,"exclusive_lock_hold_duration_s":0.02959026,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.069686,"completed_at":"2026-08-16T17:05:09.871Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027086,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.344925] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.874Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"befa34fbf93dbe590729616a","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-befa34fbf93dbe590729616a: start","job_status":"start","queue_duration_s":1.196173,"scheduling_latency_s":1.196204} gitlab # [ 259.356907] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.901Z","message":"No existing merge request to be cleaned up."} gitlab # [ 259.358515] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.923Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"befa34fbf93dbe590729616a","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-befa34fbf93dbe590729616a: done: 0.049208 sec","job_status":"done","queue_duration_s":1.196173,"scheduling_latency_s":1.196204,"redis_calls":13,"redis_duration_s":0.004626,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000657,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002435,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030861,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067678,"duration_s":0.049208,"completed_at":"2026-08-16T17:05:09.923Z","load_balancing_strategy":"primary","db_duration_s":0.007004,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.399356] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.925Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9d18dfe580bb16f3a6d0a0d5","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9d18dfe580bb16f3a6d0a0d5: start","job_status":"start","queue_duration_s":1.247468,"scheduling_latency_s":1.247493} gitlab # [ 259.411841] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.940Z","message":"No existing merge request to be cleaned up."} gitlab # [ 259.413624] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.951Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9d18dfe580bb16f3a6d0a0d5","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9d18dfe580bb16f3a6d0a0d5: done: 0.026597 sec","job_status":"done","queue_duration_s":1.247468,"scheduling_latency_s":1.247493,"redis_calls":10,"redis_duration_s":0.002768,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0011,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001668,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026597,"completed_at":"2026-08-16T17:05:09.951Z","load_balancing_strategy":"primary","db_duration_s":0.002667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.451547] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.953Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"480e5ad3596e0af6b17104c2","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-480e5ad3596e0af6b17104c2: start","job_status":"start","queue_duration_s":1.275889,"scheduling_latency_s":1.275911} gitlab # [ 259.464057] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.967Z","message":"No existing merge request to be cleaned up."} gitlab # [ 259.465695] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.978Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"480e5ad3596e0af6b17104c2","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-480e5ad3596e0af6b17104c2: done: 0.024731 sec","job_status":"done","queue_duration_s":1.275889,"scheduling_latency_s":1.275911,"redis_calls":10,"redis_duration_s":0.0028910000000000003,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024731,"completed_at":"2026-08-16T17:05:09.978Z","load_balancing_strategy":"primary","db_duration_s":0.002707,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.503885] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.980Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3ab84fbabcb7c4f7236d5034","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3ab84fbabcb7c4f7236d5034: start","job_status":"start","queue_duration_s":1.302316,"scheduling_latency_s":1.302336} gitlab # [ 259.516407] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:09.992Z","message":"No existing merge request to be cleaned up."} gitlab # [ 259.518057] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.002Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3ab84fbabcb7c4f7236d5034","created_at":"2026-08-16T17:05:08.656Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-ae47ef13a20a4fb1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"8d4d994588265d538fd01ea617d35480","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.677Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3ab84fbabcb7c4f7236d5034: done: 0.022342 sec","job_status":"done","queue_duration_s":1.302316,"scheduling_latency_s":1.302336,"redis_calls":10,"redis_duration_s":0.002584,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001481,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014376,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022342,"completed_at":"2026-08-16T17:05:10.002Z","load_balancing_strategy":"primary","db_duration_s":0.002491,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.556123] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c441e0db74f908fd5ea0689","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c441e0db74f908fd5ea0689: start","job_status":"start","queue_duration_s":1.140111,"scheduling_latency_s":1.140129} gitlab # [ 259.568428] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c441e0db74f908fd5ea0689","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c441e0db74f908fd5ea0689: done: 0.023481 sec","job_status":"done","queue_duration_s":1.140111,"scheduling_latency_s":1.140129,"redis_calls":16,"redis_duration_s":0.003912,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000494,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001187,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002231,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003445,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023481,"completed_at":"2026-08-16T17:05:10.027Z","load_balancing_strategy":"primary","db_duration_s":0.000654,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.609765] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5282663717cb5a4446f8d2c","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5282663717cb5a4446f8d2c: start","job_status":"start","queue_duration_s":1.16504,"scheduling_latency_s":1.165058} gitlab # [ 259.622181] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5282663717cb5a4446f8d2c","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5282663717cb5a4446f8d2c: done: 0.015404 sec","job_status":"done","queue_duration_s":1.16504,"scheduling_latency_s":1.165058,"redis_calls":13,"redis_duration_s":0.002711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001793,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015404,"completed_at":"2026-08-16T17:05:10.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.660956] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abc7457e6294002e311b2566","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abc7457e6294002e311b2566: start","job_status":"start","queue_duration_s":1.181758,"scheduling_latency_s":1.181775} gitlab # [ 259.673236] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abc7457e6294002e311b2566","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abc7457e6294002e311b2566: done: 0.015825 sec","job_status":"done","queue_duration_s":1.181758,"scheduling_latency_s":1.181775,"redis_calls":13,"redis_duration_s":0.003009,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009533,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015825,"completed_at":"2026-08-16T17:05:10.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.713230] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.063Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"791394a8def5ed1cfe1d5d85","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-791394a8def5ed1cfe1d5d85: start","job_status":"start","queue_duration_s":1.199057,"scheduling_latency_s":1.199074} gitlab # [ 259.725319] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"791394a8def5ed1cfe1d5d85","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-791394a8def5ed1cfe1d5d85: done: 0.015703 sec","job_status":"done","queue_duration_s":1.199057,"scheduling_latency_s":1.199074,"redis_calls":13,"redis_duration_s":0.003136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001078,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002058,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015703,"completed_at":"2026-08-16T17:05:10.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.764166] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d379321761472f8069b62ce","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d379321761472f8069b62ce: start","job_status":"start","queue_duration_s":1.216094,"scheduling_latency_s":1.21611} gitlab # [ 259.776036] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3d379321761472f8069b62ce","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3d379321761472f8069b62ce: done: 0.01529 sec","job_status":"done","queue_duration_s":1.216094,"scheduling_latency_s":1.21611,"redis_calls":13,"redis_duration_s":0.002634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009548,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01529,"completed_at":"2026-08-16T17:05:10.095Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.815555] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bca639117b89b1030127f069","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bca639117b89b1030127f069: start","job_status":"start","queue_duration_s":1.23271,"scheduling_latency_s":1.232727} gitlab # [ 259.827658] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bca639117b89b1030127f069","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bca639117b89b1030127f069: done: 0.015131 sec","job_status":"done","queue_duration_s":1.23271,"scheduling_latency_s":1.232727,"redis_calls":13,"redis_duration_s":0.002837,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000963,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015131,"completed_at":"2026-08-16T17:05:10.111Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.866495] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca1a59d0b5c790a027b0940e","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca1a59d0b5c790a027b0940e: start","job_status":"start","queue_duration_s":1.249529,"scheduling_latency_s":1.249547} gitlab # [ 259.878498] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca1a59d0b5c790a027b0940e","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca1a59d0b5c790a027b0940e: done: 0.015207 sec","job_status":"done","queue_duration_s":1.249529,"scheduling_latency_s":1.249547,"redis_calls":13,"redis_duration_s":0.0027949999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000861,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015207,"completed_at":"2026-08-16T17:05:10.128Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.918228] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0458cd38132941ead2e64719","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0458cd38132941ead2e64719: start","job_status":"start","queue_duration_s":1.266217,"scheduling_latency_s":1.266234} gitlab # [ 259.930906] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0458cd38132941ead2e64719","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0458cd38132941ead2e64719: done: 0.014959 sec","job_status":"done","queue_duration_s":1.266217,"scheduling_latency_s":1.266234,"redis_calls":13,"redis_duration_s":0.002643,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014959,"completed_at":"2026-08-16T17:05:10.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 259.970222] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89b97de9ae5036a1d20146b2","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89b97de9ae5036a1d20146b2: start","job_status":"start","queue_duration_s":1.282635,"scheduling_latency_s":1.282652} gitlab # [ 259.982792] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89b97de9ae5036a1d20146b2","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89b97de9ae5036a1d20146b2: done: 0.015298 sec","job_status":"done","queue_duration_s":1.282635,"scheduling_latency_s":1.282652,"redis_calls":13,"redis_duration_s":0.002633,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015298,"completed_at":"2026-08-16T17:05:10.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.023042] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28793bd0f2c106d563517349","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28793bd0f2c106d563517349: start","job_status":"start","queue_duration_s":1.299585,"scheduling_latency_s":1.299602} gitlab # [ 260.036746] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28793bd0f2c106d563517349","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28793bd0f2c106d563517349: done: 0.015501 sec","job_status":"done","queue_duration_s":1.299585,"scheduling_latency_s":1.299602,"redis_calls":13,"redis_duration_s":0.002835,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001868,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015501,"completed_at":"2026-08-16T17:05:10.178Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.077658] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2760ec79ae878aa050cbac8e","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2760ec79ae878aa050cbac8e: start","job_status":"start","queue_duration_s":1.316564,"scheduling_latency_s":1.316581} gitlab # [ 260.090677] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2760ec79ae878aa050cbac8e","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2760ec79ae878aa050cbac8e: done: 0.015337 sec","job_status":"done","queue_duration_s":1.316564,"scheduling_latency_s":1.316581,"redis_calls":13,"redis_duration_s":0.002734,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00183,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00973,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015337,"completed_at":"2026-08-16T17:05:10.195Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.132387] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef379e19d73f69faa1096439","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef379e19d73f69faa1096439: start","job_status":"start","queue_duration_s":1.333217,"scheduling_latency_s":1.333233} gitlab # [ 260.144919] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.212Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ef379e19d73f69faa1096439","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ef379e19d73f69faa1096439: done: 0.015328 sec","job_status":"done","queue_duration_s":1.333217,"scheduling_latency_s":1.333233,"redis_calls":13,"redis_duration_s":0.0027,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000897,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001803,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015328,"completed_at":"2026-08-16T17:05:10.212Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.183721] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.213Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34ff5a406c683995da2d4a00","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34ff5a406c683995da2d4a00: start","job_status":"start","queue_duration_s":1.349963,"scheduling_latency_s":1.34998} gitlab # [ 260.196302] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.229Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34ff5a406c683995da2d4a00","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34ff5a406c683995da2d4a00: done: 0.015429 sec","job_status":"done","queue_duration_s":1.349963,"scheduling_latency_s":1.34998,"redis_calls":13,"redis_duration_s":0.0026579999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001735,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009592,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015429,"completed_at":"2026-08-16T17:05:10.229Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.235971] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.230Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a48c28afc500cef60ea4e063","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a48c28afc500cef60ea4e063: start","job_status":"start","queue_duration_s":1.366795,"scheduling_latency_s":1.366812} gitlab # [ 260.248275] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a48c28afc500cef60ea4e063","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a48c28afc500cef60ea4e063: done: 0.015367 sec","job_status":"done","queue_duration_s":1.366795,"scheduling_latency_s":1.366812,"redis_calls":13,"redis_duration_s":0.002613,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001737,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015367,"completed_at":"2026-08-16T17:05:10.246Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.288261] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51cfa9d21bf3bcc92242fbe8","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51cfa9d21bf3bcc92242fbe8: start","job_status":"start","queue_duration_s":1.383561,"scheduling_latency_s":1.383578} gitlab # [ 260.300816] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51cfa9d21bf3bcc92242fbe8","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51cfa9d21bf3bcc92242fbe8: done: 0.015609 sec","job_status":"done","queue_duration_s":1.383561,"scheduling_latency_s":1.383578,"redis_calls":13,"redis_duration_s":0.00277,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001819,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015609,"completed_at":"2026-08-16T17:05:10.263Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.341141] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8787ffb22170b9aee7fc00c","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8787ffb22170b9aee7fc00c: start","job_status":"start","queue_duration_s":1.400577,"scheduling_latency_s":1.400594} gitlab # [ 260.353824] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.280Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8787ffb22170b9aee7fc00c","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8787ffb22170b9aee7fc00c: done: 0.015851 sec","job_status":"done","queue_duration_s":1.400577,"scheduling_latency_s":1.400594,"redis_calls":13,"redis_duration_s":0.00292,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000984,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009561,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015851,"completed_at":"2026-08-16T17:05:10.280Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.394115] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"825346ff45a731260180346b","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-825346ff45a731260180346b: start","job_status":"start","queue_duration_s":1.417717,"scheduling_latency_s":1.417734} gitlab # [ 260.406223] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"825346ff45a731260180346b","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-825346ff45a731260180346b: done: 0.015084 sec","job_status":"done","queue_duration_s":1.417717,"scheduling_latency_s":1.417734,"redis_calls":13,"redis_duration_s":0.002725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009384,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015084,"completed_at":"2026-08-16T17:05:10.296Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.445609] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.298Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63c7e34ef01081954bf80ab7","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63c7e34ef01081954bf80ab7: start","job_status":"start","queue_duration_s":1.434097,"scheduling_latency_s":1.434113} gitlab # [ 260.457918] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63c7e34ef01081954bf80ab7","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63c7e34ef01081954bf80ab7: done: 0.01525 sec","job_status":"done","queue_duration_s":1.434097,"scheduling_latency_s":1.434113,"redis_calls":13,"redis_duration_s":0.002462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001561,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009825,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01525,"completed_at":"2026-08-16T17:05:10.313Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.496207] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49c9204c28e1286eff3b4b2d","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49c9204c28e1286eff3b4b2d: start","job_status":"start","queue_duration_s":1.450964,"scheduling_latency_s":1.450981} gitlab # [ 260.508265] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49c9204c28e1286eff3b4b2d","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49c9204c28e1286eff3b4b2d: done: 0.015678 sec","job_status":"done","queue_duration_s":1.450964,"scheduling_latency_s":1.450981,"redis_calls":13,"redis_duration_s":0.002915,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001058,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001857,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015678,"completed_at":"2026-08-16T17:05:10.330Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.548258] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"822bbae6194c87143e2f3c60","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-822bbae6194c87143e2f3c60: start","job_status":"start","queue_duration_s":1.468517,"scheduling_latency_s":1.468535} gitlab # [ 260.560946] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"822bbae6194c87143e2f3c60","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-822bbae6194c87143e2f3c60: done: 0.015614 sec","job_status":"done","queue_duration_s":1.468517,"scheduling_latency_s":1.468535,"redis_calls":13,"redis_duration_s":0.002686,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001743,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015614,"completed_at":"2026-08-16T17:05:10.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.600981] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fd8fd4bde6520826406d6fb","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fd8fd4bde6520826406d6fb: start","job_status":"start","queue_duration_s":1.485678,"scheduling_latency_s":1.485695} gitlab # [ 260.614602] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fd8fd4bde6520826406d6fb","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fd8fd4bde6520826406d6fb: done: 0.01634 sec","job_status":"done","queue_duration_s":1.485678,"scheduling_latency_s":1.485695,"redis_calls":13,"redis_duration_s":0.003245,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002279,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01634,"completed_at":"2026-08-16T17:05:10.365Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.654678] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.367Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34513c686a3136089ff77a9c","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34513c686a3136089ff77a9c: start","job_status":"start","queue_duration_s":1.50359,"scheduling_latency_s":1.50361} gitlab # [ 260.666824] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34513c686a3136089ff77a9c","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34513c686a3136089ff77a9c: done: 0.01652 sec","job_status":"done","queue_duration_s":1.50359,"scheduling_latency_s":1.50361,"redis_calls":13,"redis_duration_s":0.00281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001828,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010642,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01652,"completed_at":"2026-08-16T17:05:10.383Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.705650] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64eb190b8c1dc9aa3530b112","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64eb190b8c1dc9aa3530b112: start","job_status":"start","queue_duration_s":1.521535,"scheduling_latency_s":1.521554} gitlab # [ 260.717882] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"64eb190b8c1dc9aa3530b112","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-64eb190b8c1dc9aa3530b112: done: 0.016576 sec","job_status":"done","queue_duration_s":1.521535,"scheduling_latency_s":1.521554,"redis_calls":13,"redis_duration_s":0.003018,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002065,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010435,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016576,"completed_at":"2026-08-16T17:05:10.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.756473] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b9d17c1531e85d371900a05","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b9d17c1531e85d371900a05: start","job_status":"start","queue_duration_s":1.540505,"scheduling_latency_s":1.540555} gitlab # [ 260.768844] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0b9d17c1531e85d371900a05","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0b9d17c1531e85d371900a05: done: 0.038853 sec","job_status":"done","queue_duration_s":1.540505,"scheduling_latency_s":1.540555,"redis_calls":13,"redis_duration_s":0.0032440000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001185,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027172,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.038853,"completed_at":"2026-08-16T17:05:10.443Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.807712] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a46e3411f68518c818010cd","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a46e3411f68518c818010cd: start","job_status":"start","queue_duration_s":1.581533,"scheduling_latency_s":1.581566} gitlab # [ 260.820906] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.474Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4a46e3411f68518c818010cd","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4a46e3411f68518c818010cd: done: 0.029007 sec","job_status":"done","queue_duration_s":1.581533,"scheduling_latency_s":1.581566,"redis_calls":13,"redis_duration_s":0.0033610000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002349,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029007,"completed_at":"2026-08-16T17:05:10.474Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.859842] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.476Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca26a35a167127a90c6dc020","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca26a35a167127a90c6dc020: start","job_status":"start","queue_duration_s":1.612671,"scheduling_latency_s":1.612703} gitlab # [ 260.872882] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca26a35a167127a90c6dc020","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca26a35a167127a90c6dc020: done: 0.027753 sec","job_status":"done","queue_duration_s":1.612671,"scheduling_latency_s":1.612703,"redis_calls":13,"redis_duration_s":0.0035919999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002433,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027753,"completed_at":"2026-08-16T17:05:10.504Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.912776] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.506Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e06b1449c440a6960da5ed72","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e06b1449c440a6960da5ed72: start","job_status":"start","queue_duration_s":1.642485,"scheduling_latency_s":1.642513} gitlab # [ 260.925324] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e06b1449c440a6960da5ed72","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e06b1449c440a6960da5ed72: done: 0.023698 sec","job_status":"done","queue_duration_s":1.642485,"scheduling_latency_s":1.642513,"redis_calls":13,"redis_duration_s":0.003253,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.023698,"completed_at":"2026-08-16T17:05:10.530Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 260.963987] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"181cc483172f82a639c91b74","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-181cc483172f82a639c91b74: start","job_status":"start","queue_duration_s":1.668154,"scheduling_latency_s":1.668178} gitlab # [ 260.975870] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"181cc483172f82a639c91b74","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-181cc483172f82a639c91b74: done: 0.018796 sec","job_status":"done","queue_duration_s":1.668154,"scheduling_latency_s":1.668178,"redis_calls":13,"redis_duration_s":0.002687,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000972,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018796,"completed_at":"2026-08-16T17:05:10.550Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.014750] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c478034e2dddac4234b41f8a","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c478034e2dddac4234b41f8a: start","job_status":"start","queue_duration_s":1.688639,"scheduling_latency_s":1.688659} gitlab # [ 261.028066] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c478034e2dddac4234b41f8a","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c478034e2dddac4234b41f8a: done: 0.018488 sec","job_status":"done","queue_duration_s":1.688639,"scheduling_latency_s":1.688659,"redis_calls":13,"redis_duration_s":0.003267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000977,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00229,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011281,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018488,"completed_at":"2026-08-16T17:05:10.571Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.066874] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b4d2f940be763bf2c96f4bf","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b4d2f940be763bf2c96f4bf: start","job_status":"start","queue_duration_s":1.708755,"scheduling_latency_s":1.708774} gitlab # [ 261.079382] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b4d2f940be763bf2c96f4bf","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b4d2f940be763bf2c96f4bf: done: 0.017498 sec","job_status":"done","queue_duration_s":1.708755,"scheduling_latency_s":1.708774,"redis_calls":13,"redis_duration_s":0.0029519999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01138,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017498,"completed_at":"2026-08-16T17:05:10.590Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.118438] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.592Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15a1155f1c8b3c155593e30f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15a1155f1c8b3c155593e30f: start","job_status":"start","queue_duration_s":1.728025,"scheduling_latency_s":1.728045} gitlab # [ 261.130779] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.608Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"15a1155f1c8b3c155593e30f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-15a1155f1c8b3c155593e30f: done: 0.016539 sec","job_status":"done","queue_duration_s":1.728025,"scheduling_latency_s":1.728045,"redis_calls":13,"redis_duration_s":0.002778,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000983,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001795,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010598,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016539,"completed_at":"2026-08-16T17:05:10.608Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.169552] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d2a90fe237f3385b16a0f45","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d2a90fe237f3385b16a0f45: start","job_status":"start","queue_duration_s":1.746091,"scheduling_latency_s":1.74611} gitlab # [ 261.181917] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8d2a90fe237f3385b16a0f45","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8d2a90fe237f3385b16a0f45: done: 0.015769 sec","job_status":"done","queue_duration_s":1.746091,"scheduling_latency_s":1.74611,"redis_calls":13,"redis_duration_s":0.002731,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01007,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015769,"completed_at":"2026-08-16T17:05:10.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.220514] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0039795708217d3f451805e","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0039795708217d3f451805e: start","job_status":"start","queue_duration_s":1.763342,"scheduling_latency_s":1.76336} gitlab # [ 261.233690] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0039795708217d3f451805e","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0039795708217d3f451805e: done: 0.016117 sec","job_status":"done","queue_duration_s":1.763342,"scheduling_latency_s":1.76336,"redis_calls":13,"redis_duration_s":0.002789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001831,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016117,"completed_at":"2026-08-16T17:05:10.643Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.272265] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f18f272ea0231fce25be582","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f18f272ea0231fce25be582: start","job_status":"start","queue_duration_s":1.780861,"scheduling_latency_s":1.780877} gitlab # [ 261.284153] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6f18f272ea0231fce25be582","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6f18f272ea0231fce25be582: done: 0.015792 sec","job_status":"done","queue_duration_s":1.780861,"scheduling_latency_s":1.780877,"redis_calls":13,"redis_duration_s":0.002732,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00181,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00982,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015792,"completed_at":"2026-08-16T17:05:10.660Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.322508] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c204acfcc775ede6f6ce12f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c204acfcc775ede6f6ce12f: start","job_status":"start","queue_duration_s":1.798022,"scheduling_latency_s":1.79804} gitlab # [ 261.334789] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c204acfcc775ede6f6ce12f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c204acfcc775ede6f6ce12f: done: 0.016595 sec","job_status":"done","queue_duration_s":1.798022,"scheduling_latency_s":1.79804,"redis_calls":13,"redis_duration_s":0.002989,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010078,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016595,"completed_at":"2026-08-16T17:05:10.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.374718] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.680Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c69d8dc3c60dbbeb098e924","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c69d8dc3c60dbbeb098e924: start","job_status":"start","queue_duration_s":1.816149,"scheduling_latency_s":1.816167} gitlab # [ 261.387714] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3c69d8dc3c60dbbeb098e924","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3c69d8dc3c60dbbeb098e924: done: 0.016825 sec","job_status":"done","queue_duration_s":1.816149,"scheduling_latency_s":1.816167,"redis_calls":13,"redis_duration_s":0.002777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016825,"completed_at":"2026-08-16T17:05:10.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.427167] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7913fa699dc908e460aecb63","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7913fa699dc908e460aecb63: start","job_status":"start","queue_duration_s":1.833971,"scheduling_latency_s":1.833988} gitlab # [ 261.440319] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7913fa699dc908e460aecb63","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7913fa699dc908e460aecb63: done: 0.015634 sec","job_status":"done","queue_duration_s":1.833971,"scheduling_latency_s":1.833988,"redis_calls":13,"redis_duration_s":0.001824,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000604,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015634,"completed_at":"2026-08-16T17:05:10.713Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.479273] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52670c6da8676f856abc3e9f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52670c6da8676f856abc3e9f: start","job_status":"start","queue_duration_s":1.850906,"scheduling_latency_s":1.850925} gitlab # [ 261.491836] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.730Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52670c6da8676f856abc3e9f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52670c6da8676f856abc3e9f: done: 0.016002 sec","job_status":"done","queue_duration_s":1.850906,"scheduling_latency_s":1.850925,"redis_calls":13,"redis_duration_s":0.00167,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000979,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016002,"completed_at":"2026-08-16T17:05:10.730Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.530608] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51faaf1d87f3b8994feed43d","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51faaf1d87f3b8994feed43d: start","job_status":"start","queue_duration_s":1.868263,"scheduling_latency_s":1.868282} gitlab # [ 261.543001] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51faaf1d87f3b8994feed43d","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51faaf1d87f3b8994feed43d: done: 0.016929 sec","job_status":"done","queue_duration_s":1.868263,"scheduling_latency_s":1.868282,"redis_calls":13,"redis_duration_s":0.001986,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000597,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001389,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016929,"completed_at":"2026-08-16T17:05:10.749Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.581848] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bd8185124dca019d1cec274","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bd8185124dca019d1cec274: start","job_status":"start","queue_duration_s":1.886538,"scheduling_latency_s":1.886557} gitlab # [ 261.593915] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8bd8185124dca019d1cec274","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8bd8185124dca019d1cec274: done: 0.015504 sec","job_status":"done","queue_duration_s":1.886538,"scheduling_latency_s":1.886557,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000977,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01067,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015504,"completed_at":"2026-08-16T17:05:10.765Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.633417] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04de30204efa5a44c012a337","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04de30204efa5a44c012a337: start","job_status":"start","queue_duration_s":1.903371,"scheduling_latency_s":1.90339} gitlab # [ 261.645812] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04de30204efa5a44c012a337","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04de30204efa5a44c012a337: done: 0.014995 sec","job_status":"done","queue_duration_s":1.903371,"scheduling_latency_s":1.90339,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014995,"completed_at":"2026-08-16T17:05:10.782Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.684276] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae8a58d29d6fc38b5f065a60","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae8a58d29d6fc38b5f065a60: start","job_status":"start","queue_duration_s":1.919634,"scheduling_latency_s":1.919654} gitlab # [ 261.696147] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae8a58d29d6fc38b5f065a60","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae8a58d29d6fc38b5f065a60: done: 0.015378 sec","job_status":"done","queue_duration_s":1.919634,"scheduling_latency_s":1.919654,"redis_calls":13,"redis_duration_s":0.001694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015378,"completed_at":"2026-08-16T17:05:10.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.734772] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52ad8d15c8efd3842e57c81b","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52ad8d15c8efd3842e57c81b: start","job_status":"start","queue_duration_s":1.93606,"scheduling_latency_s":1.936078} gitlab # [ 261.747346] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.815Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52ad8d15c8efd3842e57c81b","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52ad8d15c8efd3842e57c81b: done: 0.015094 sec","job_status":"done","queue_duration_s":1.93606,"scheduling_latency_s":1.936078,"redis_calls":13,"redis_duration_s":0.001444,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015094,"completed_at":"2026-08-16T17:05:10.815Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.786212] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dc9a2c1d3bc03898ea9b185","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dc9a2c1d3bc03898ea9b185: start","job_status":"start","queue_duration_s":1.952199,"scheduling_latency_s":1.952217} gitlab # [ 261.798332] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.831Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2dc9a2c1d3bc03898ea9b185","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2dc9a2c1d3bc03898ea9b185: done: 0.015159 sec","job_status":"done","queue_duration_s":1.952199,"scheduling_latency_s":1.952217,"redis_calls":13,"redis_duration_s":0.0015329999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000547,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000986,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010332,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015159,"completed_at":"2026-08-16T17:05:10.831Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.838094] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.832Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bec266b622cd36b00161e330","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bec266b622cd36b00161e330: start","job_status":"start","queue_duration_s":1.968434,"scheduling_latency_s":1.968452} gitlab # [ 261.850486] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.847Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bec266b622cd36b00161e330","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bec266b622cd36b00161e330: done: 0.015192 sec","job_status":"done","queue_duration_s":1.968434,"scheduling_latency_s":1.968452,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015192,"completed_at":"2026-08-16T17:05:10.847Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.889146] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.848Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abbf58a64304539b0b8cd6eb","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abbf58a64304539b0b8cd6eb: start","job_status":"start","queue_duration_s":1.984943,"scheduling_latency_s":1.984962} gitlab # [ 261.901220] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.864Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"abbf58a64304539b0b8cd6eb","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-abbf58a64304539b0b8cd6eb: done: 0.015262 sec","job_status":"done","queue_duration_s":1.984943,"scheduling_latency_s":1.984962,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015262,"completed_at":"2026-08-16T17:05:10.864Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.940801] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98c6cbb3a66b2554fa8464c0","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98c6cbb3a66b2554fa8464c0: start","job_status":"start","queue_duration_s":2.001541,"scheduling_latency_s":2.00156} gitlab # [ 261.953628] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.880Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"98c6cbb3a66b2554fa8464c0","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-98c6cbb3a66b2554fa8464c0: done: 0.015186 sec","job_status":"done","queue_duration_s":2.001541,"scheduling_latency_s":2.00156,"redis_calls":13,"redis_duration_s":0.0014819999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010525,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015186,"completed_at":"2026-08-16T17:05:10.880Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 261.993991] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49b194b9f95a1ff59b1c254f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49b194b9f95a1ff59b1c254f: start","job_status":"start","queue_duration_s":2.018025,"scheduling_latency_s":2.018044} gitlab # [ 262.007044] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.897Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49b194b9f95a1ff59b1c254f","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49b194b9f95a1ff59b1c254f: done: 0.015124 sec","job_status":"done","queue_duration_s":2.018025,"scheduling_latency_s":2.018044,"redis_calls":13,"redis_duration_s":0.0015660000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000582,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01052,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015124,"completed_at":"2026-08-16T17:05:10.897Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.047067] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8619c22a44307eb7cde0f3ad","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8619c22a44307eb7cde0f3ad: start","job_status":"start","queue_duration_s":2.034582,"scheduling_latency_s":2.034603} gitlab # [ 262.059630] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.913Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8619c22a44307eb7cde0f3ad","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8619c22a44307eb7cde0f3ad: done: 0.015062 sec","job_status":"done","queue_duration_s":2.034582,"scheduling_latency_s":2.034603,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010522,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015062,"completed_at":"2026-08-16T17:05:10.913Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 262.098811] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.914Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05fb189fb49c1e77bbf1927b","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05fb189fb49c1e77bbf1927b: start","job_status":"start","queue_duration_s":2.050763,"scheduling_latency_s":2.050781} gitlab # [ 262.111434] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:05:10.929Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05fb189fb49c1e77bbf1927b","created_at":"2026-08-16T17:05:08.781Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-7ee2f1748abf4408","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"856a5b88819b36dffa93560022b8d953","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:05:08.863Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05fb189fb49c1e77bbf1927b: done: 0.015143 sec","job_status":"done","queue_duration_s":2.050763,"scheduling_latency_s":2.050781,"redis_calls":13,"redis_duration_s":0.001478,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015143,"completed_at":"2026-08-16T17:05:10.929Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 286.631204] setup-gitlab-start[3064]: W, [2026-08-16T17:05:37.295981 #3064] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 310.413123] redis[787]: 10 changes in 300 seconds. Saving... gitlab # [ 310.419426] redis[787]: Background saving started by pid 3342 gitlab # [ 310.423600] redis[3342]: BGSAVE done, 414 keys saved, 0 keys skipped, 110957 bytes written. gitlab # [ 310.429304] redis[3342]: DB saved on disk gitlab # [ 310.431525] redis[3342]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB gitlab # [ 310.514686] redis[787]: Background saving terminated with success gitlab # [ 311.721174] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.385Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"599f3994fba8a79452163ed7","created_at":"2026-08-16T17:06:02.352Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0309bb794cb150e9464e3bbd1661a54","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.381Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-599f3994fba8a79452163ed7: start","job_status":"start","queue_duration_s":0.003385,"scheduling_latency_s":0.003439} gitlab # [ 311.915357] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.580Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"599f3994fba8a79452163ed7","created_at":"2026-08-16T17:06:02.352Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c0309bb794cb150e9464e3bbd1661a54","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.381Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-599f3994fba8a79452163ed7: done: 0.194899 sec","job_status":"done","queue_duration_s":0.003385,"scheduling_latency_s":0.003439,"redis_calls":17,"redis_duration_s":0.079578,"redis_read_bytes":905,"redis_write_bytes":1674,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.068189,"redis_feature_flag_read_bytes":898,"redis_feature_flag_write_bytes":790,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008988,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002401,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.065929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0010759,"duration_s":0.194899,"completed_at":"2026-08-16T17:06:02.580Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027884,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 312.005281] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.585Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"bdff8525b9bb98181f9bd2d8","created_at":"2026-08-16T17:06:02.402Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edd7311bccd875d24de6f1a31c78bbb5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.418Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-bdff8525b9bb98181f9bd2d8: start","job_status":"start","queue_duration_s":0.16627,"scheduling_latency_s":0.166321} gitlab # [ 312.022738] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.657Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 312.026813] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.684Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"bdff8525b9bb98181f9bd2d8","created_at":"2026-08-16T17:06:02.402Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edd7311bccd875d24de6f1a31c78bbb5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.418Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-bdff8525b9bb98181f9bd2d8: done: 0.099072 sec","job_status":"done","queue_duration_s":0.16627,"scheduling_latency_s":0.166321,"redis_calls":7,"redis_duration_s":0.049031,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.046616,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002415,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.099072,"completed_at":"2026-08-16T17:06:02.683Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 312.069383] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6338d1be461babe66a7af2e0","created_at":"2026-08-16T17:06:02.444Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a38cbed24f4e991dab277d58f82b428c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:06:02.457Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6338d1be461babe66a7af2e0: start","job_status":"start","queue_duration_s":0.24818,"scheduling_latency_s":0.248236} gitlab # [ 312.102457] postgres[858]: [858] LOG: checkpoint starting: time gitlab # [ 312.171018] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.835Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"6338d1be461babe66a7af2e0","created_at":"2026-08-16T17:06:02.444Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a38cbed24f4e991dab277d58f82b428c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-16T17:06:02.457Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-6338d1be461babe66a7af2e0: done: 0.129917 sec","job_status":"done","queue_duration_s":0.24818,"scheduling_latency_s":0.248236,"redis_calls":8,"redis_duration_s":0.050151,"redis_read_bytes":133,"redis_write_bytes":811,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.018941,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.027931,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003279,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.129917,"completed_at":"2026-08-16T17:06:02.835Z","load_balancing_strategy":"primary","db_duration_s":0.008432,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 312.264079] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:02.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a809620a93ee4c65a47ac978","created_at":"2026-08-16T17:06:02.522Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2eba4bb9739eafcfdc91d40b1180cab","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.531Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a809620a93ee4c65a47ac978: start","job_status":"start","queue_duration_s":0.336621,"scheduling_latency_s":0.336674} gitlab # [ 312.365023] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.029Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"a809620a93ee4c65a47ac978","created_at":"2026-08-16T17:06:02.522Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2eba4bb9739eafcfdc91d40b1180cab","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.531Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-a809620a93ee4c65a47ac978: done: 0.161827 sec","job_status":"done","queue_duration_s":0.336621,"scheduling_latency_s":0.336674,"redis_calls":9,"redis_duration_s":0.014381,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007542,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006839,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00176822,"exclusive_lock_hold_duration_s":0.01058064,"duration_s":0.161827,"completed_at":"2026-08-16T17:06:03.029Z","load_balancing_strategy":"primary","db_duration_s":0.005307,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 312.455637] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.051Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4bb950f6761fb7272c21b41a","created_at":"2026-08-16T17:06:02.536Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d940f1513888cc05052abd8b041db3ad","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.592Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4bb950f6761fb7272c21b41a: start","job_status":"start","queue_duration_s":0.458667,"scheduling_latency_s":0.458756} gitlab # [ 312.499743] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.165Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4bb950f6761fb7272c21b41a","created_at":"2026-08-16T17:06:02.536Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d940f1513888cc05052abd8b041db3ad","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.592Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4bb950f6761fb7272c21b41a: done: 0.1141 sec","job_status":"done","queue_duration_s":0.458667,"scheduling_latency_s":0.458756,"redis_calls":12,"redis_duration_s":0.002844,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000724,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000505,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000385,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062756,"duration_s":0.1141,"completed_at":"2026-08-16T17:06:03.165Z","load_balancing_strategy":"primary","db_duration_s":0.008294,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 312.553713] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.167Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"603a42dabccb4bb478e76403","created_at":"2026-08-16T17:06:02.653Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52779b17e216a016a2c53845f7305fca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.670Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-603a42dabccb4bb478e76403: start","job_status":"start","queue_duration_s":0.496893,"scheduling_latency_s":0.496921} gitlab # [ 312.568267] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"603a42dabccb4bb478e76403","created_at":"2026-08-16T17:06:02.653Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"52779b17e216a016a2c53845f7305fca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.670Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-603a42dabccb4bb478e76403: done: 0.018941 sec","job_status":"done","queue_duration_s":0.496893,"scheduling_latency_s":0.496921,"redis_calls":7,"redis_duration_s":0.0013629999999999998,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000377,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012288,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018941,"completed_at":"2026-08-16T17:06:03.186Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 312.608749] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.187Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f63ef6fece2484cdf3c30b29","created_at":"2026-08-16T17:06:02.705Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"458a9265b1301c57a30487b704e7cee1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.712Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f63ef6fece2484cdf3c30b29: start","job_status":"start","queue_duration_s":0.47483,"scheduling_latency_s":0.474853} gitlab # [ 312.622702] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.196Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 312.625920] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"f63ef6fece2484cdf3c30b29","created_at":"2026-08-16T17:06:02.705Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"458a9265b1301c57a30487b704e7cee1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.712Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-f63ef6fece2484cdf3c30b29: done: 0.015797 sec","job_status":"done","queue_duration_s":0.47483,"scheduling_latency_s":0.474853,"redis_calls":7,"redis_duration_s":0.001126,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000308,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015797,"completed_at":"2026-08-16T17:06:03.203Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 312.665716] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"76be53027cb7567d8f1e1622","created_at":"2026-08-16T17:06:02.776Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a05ce6243d1955a1ad4e3a74c340748","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.782Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-76be53027cb7567d8f1e1622: start","job_status":"start","queue_duration_s":0.42236,"scheduling_latency_s":0.42238} gitlab # [ 312.680639] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.222Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"76be53027cb7567d8f1e1622","created_at":"2026-08-16T17:06:02.776Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a05ce6243d1955a1ad4e3a74c340748","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.782Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-76be53027cb7567d8f1e1622: done: 0.017678 sec","job_status":"done","queue_duration_s":0.42236,"scheduling_latency_s":0.42238,"redis_calls":7,"redis_duration_s":0.001078,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000778,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.0003,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010905,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017678,"completed_at":"2026-08-16T17:06:03.222Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 312.720496] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"1d34b90eb1447612ebe92c3b","created_at":"2026-08-16T17:06:02.823Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"187347d2267e6674649076a529590589","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.830Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-1d34b90eb1447612ebe92c3b: start","job_status":"start","queue_duration_s":0.392811,"scheduling_latency_s":0.39283} gitlab # [ 312.873719] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.538Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"1d34b90eb1447612ebe92c3b","created_at":"2026-08-16T17:06:02.823Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"187347d2267e6674649076a529590589","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.830Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-1d34b90eb1447612ebe92c3b: done: 0.314806 sec","job_status":"done","queue_duration_s":0.392811,"scheduling_latency_s":0.39283,"redis_calls":11,"redis_duration_s":0.002395,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00028,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00113,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000985,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.064,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.064,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.233841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048728,"exclusive_lock_hold_duration_s":0.28894788,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.314806,"completed_at":"2026-08-16T17:06:03.538Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.094301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 312.966380] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.541Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5b7351cda009e8c10d7d89ff","created_at":"2026-08-16T17:06:02.852Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.857Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5b7351cda009e8c10d7d89ff: start","job_status":"start","queue_duration_s":0.684006,"scheduling_latency_s":0.684039} gitlab # [ 312.982310] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.581Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"5b7351cda009e8c10d7d89ff","created_at":"2026-08-16T17:06:02.852Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.857Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-5b7351cda009e8c10d7d89ff: done: 0.039209 sec","job_status":"done","queue_duration_s":0.684006,"scheduling_latency_s":0.684039,"redis_calls":14,"redis_duration_s":0.004221,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.00049,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002712,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001019,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028195,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039209,"completed_at":"2026-08-16T17:06:03.581Z","load_balancing_strategy":"primary","db_duration_s":0.002356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.023560] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.583Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c3518e7f7abd1854531fd22d","created_at":"2026-08-16T17:06:02.867Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c8c010992ccd7334736624b667ecb4f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.874Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c3518e7f7abd1854531fd22d: start","job_status":"start","queue_duration_s":0.708615,"scheduling_latency_s":0.708639} gitlab # [ 313.038184] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.593Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 313.041550] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"c3518e7f7abd1854531fd22d","created_at":"2026-08-16T17:06:02.867Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c8c010992ccd7334736624b667ecb4f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.874Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-c3518e7f7abd1854531fd22d: done: 0.016534 sec","job_status":"done","queue_duration_s":0.708615,"scheduling_latency_s":0.708639,"redis_calls":7,"redis_duration_s":0.001885,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001329,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000556,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.016534,"completed_at":"2026-08-16T17:06:03.599Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.081809] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.601Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"12c031d7592815d1d108d0d1","created_at":"2026-08-16T17:06:02.897Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56910d748e29ec8612b561dd2c2d48ac","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.902Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-12c031d7592815d1d108d0d1: start","job_status":"start","queue_duration_s":0.698502,"scheduling_latency_s":0.698522} gitlab # [ 313.097327] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.626Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"12c031d7592815d1d108d0d1","created_at":"2026-08-16T17:06:02.897Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56910d748e29ec8612b561dd2c2d48ac","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.902Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-12c031d7592815d1d108d0d1: done: 0.025276 sec","job_status":"done","queue_duration_s":0.698502,"scheduling_latency_s":0.698522,"redis_calls":10,"redis_duration_s":0.002879,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001667,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00675428,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.025276,"completed_at":"2026-08-16T17:06:03.626Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00418,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 313.139533] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.628Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"a0e0ada1ba8ff8006e960b9a","created_at":"2026-08-16T17:06:02.916Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a44bb77272910adc25a2f64dfdf0833f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.926Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-a0e0ada1ba8ff8006e960b9a: start","job_status":"start","queue_duration_s":0.70118,"scheduling_latency_s":0.701199} gitlab # [ 313.154543] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.649Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"a0e0ada1ba8ff8006e960b9a","created_at":"2026-08-16T17:06:02.916Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a44bb77272910adc25a2f64dfdf0833f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.926Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-a0e0ada1ba8ff8006e960b9a: done: 0.021169 sec","job_status":"done","queue_duration_s":0.70118,"scheduling_latency_s":0.701199,"redis_calls":12,"redis_duration_s":0.002961,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000516,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001405,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00104,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012173,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034168,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.021169,"completed_at":"2026-08-16T17:06:03.649Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.202267] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.650Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b3ed9ea87b56f72d6e0b510a","created_at":"2026-08-16T17:06:02.949Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.952Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b3ed9ea87b56f72d6e0b510a: start","job_status":"start","queue_duration_s":0.698586,"scheduling_latency_s":0.698604} gitlab # [ 313.215833] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.743Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"b3ed9ea87b56f72d6e0b510a","created_at":"2026-08-16T17:06:02.949Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.952Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-b3ed9ea87b56f72d6e0b510a: done: 0.092706 sec","job_status":"done","queue_duration_s":0.698586,"scheduling_latency_s":0.698604,"redis_calls":60,"redis_duration_s":0.014381000000000001,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000626,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.013161,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000594,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.092706,"completed_at":"2026-08-16T17:06:03.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.256671] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.744Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"597649c222c5bee48dbaf225","created_at":"2026-08-16T17:06:02.955Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12de21444b9dfb776a3af91eaa5bea6a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.958Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-597649c222c5bee48dbaf225: start","job_status":"start","queue_duration_s":0.785866,"scheduling_latency_s":0.785885} gitlab # [ 313.271105] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.752Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 313.274990] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.757Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"597649c222c5bee48dbaf225","created_at":"2026-08-16T17:06:02.955Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"12de21444b9dfb776a3af91eaa5bea6a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.958Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-597649c222c5bee48dbaf225: done: 0.012726 sec","job_status":"done","queue_duration_s":0.785866,"scheduling_latency_s":0.785885,"redis_calls":7,"redis_duration_s":0.001,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000698,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012726,"completed_at":"2026-08-16T17:06:03.757Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.316517] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.758Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3683c9bb066dd1939f87e6cb","created_at":"2026-08-16T17:06:02.964Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1a5e7496b6583c944128fd8a28c8583","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.977Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3683c9bb066dd1939f87e6cb: start","job_status":"start","queue_duration_s":0.781403,"scheduling_latency_s":0.781421} gitlab # [ 313.330326] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.785Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"3683c9bb066dd1939f87e6cb","created_at":"2026-08-16T17:06:02.964Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1a5e7496b6583c944128fd8a28c8583","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:02.977Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-3683c9bb066dd1939f87e6cb: done: 0.02651 sec","job_status":"done","queue_duration_s":0.781403,"scheduling_latency_s":0.781421,"redis_calls":7,"redis_duration_s":0.000967,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000264,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02651,"completed_at":"2026-08-16T17:06:03.784Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010908,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.370311] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.786Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"17dd47b64128c18703515d8e","created_at":"2026-08-16T17:06:02.999Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc0605b42493989e2e43cbdfca5cdca6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:06:03.008Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-17dd47b64128c18703515d8e: start","job_status":"start","queue_duration_s":0.777401,"scheduling_latency_s":0.77742} gitlab # [ 313.383708] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.793Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 313.387165] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.798Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"17dd47b64128c18703515d8e","created_at":"2026-08-16T17:06:02.999Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc0605b42493989e2e43cbdfca5cdca6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-16T17:06:03.008Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-17dd47b64128c18703515d8e: done: 0.0123 sec","job_status":"done","queue_duration_s":0.777401,"scheduling_latency_s":0.77742,"redis_calls":7,"redis_duration_s":0.0009170000000000001,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000657,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00026,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.0123,"completed_at":"2026-08-16T17:06:03.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.426418] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.799Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"68f43158de1c8a351814ff78","created_at":"2026-08-16T17:06:03.023Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18c65d303ef3dcf21ad392013c36ddd6","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.039Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-68f43158de1c8a351814ff78: start","job_status":"start","queue_duration_s":0.759584,"scheduling_latency_s":0.759602} gitlab # [ 313.440944] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.893Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"68f43158de1c8a351814ff78","created_at":"2026-08-16T17:06:03.023Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"18c65d303ef3dcf21ad392013c36ddd6","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.039Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-68f43158de1c8a351814ff78: done: 0.093931 sec","job_status":"done","queue_duration_s":0.759584,"scheduling_latency_s":0.759602,"redis_calls":12,"redis_duration_s":0.001707,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000293,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000649,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.078249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047626,"exclusive_lock_hold_duration_s":0.008789219999999999,"duration_s":0.093931,"completed_at":"2026-08-16T17:06:03.893Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006423,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.483353] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.894Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"346ed63b10f5a54720544d18","created_at":"2026-08-16T17:06:03.050Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a954788c52798d154e5949a470d83e38","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.056Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-346ed63b10f5a54720544d18: start","job_status":"start","queue_duration_s":0.838475,"scheduling_latency_s":0.838498} gitlab # [ 313.498882] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.913Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"346ed63b10f5a54720544d18","created_at":"2026-08-16T17:06:03.050Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a954788c52798d154e5949a470d83e38","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.056Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-346ed63b10f5a54720544d18: done: 0.018354 sec","job_status":"done","queue_duration_s":0.838475,"scheduling_latency_s":0.838498,"redis_calls":9,"redis_duration_s":0.001528,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000764,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000764,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000563,"exclusive_lock_hold_duration_s":0.00395622,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.018354,"completed_at":"2026-08-16T17:06:03.913Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.540082] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:03.915Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f8ae5e7a6e3a0a96029f0908","created_at":"2026-08-16T17:06:03.065Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c317cace80fb075810cf21f115f542ac","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.068Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f8ae5e7a6e3a0a96029f0908: start","job_status":"start","queue_duration_s":0.846326,"scheduling_latency_s":0.846346} gitlab # [ 313.585751] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f8ae5e7a6e3a0a96029f0908","created_at":"2026-08-16T17:06:03.065Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c317cace80fb075810cf21f115f542ac","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.068Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f8ae5e7a6e3a0a96029f0908: done: 0.336257 sec","job_status":"done","queue_duration_s":0.846326,"scheduling_latency_s":0.846346,"redis_calls":562,"redis_duration_s":0.0606,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000828,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.059772,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.312003,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.336257,"completed_at":"2026-08-16T17:06:04.251Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.627746] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"422af92d56415e5f98fbb4b7","created_at":"2026-08-16T17:06:03.089Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7179cea92bf5242d52a94fc6954d24d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.092Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-422af92d56415e5f98fbb4b7: start","job_status":"start","queue_duration_s":1.16021,"scheduling_latency_s":1.160237} gitlab # [ 313.642296] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"422af92d56415e5f98fbb4b7","created_at":"2026-08-16T17:06:03.089Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7179cea92bf5242d52a94fc6954d24d4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.092Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-422af92d56415e5f98fbb4b7: done: 0.014659 sec","job_status":"done","queue_duration_s":1.16021,"scheduling_latency_s":1.160237,"redis_calls":7,"redis_duration_s":0.000988,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000714,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014659,"completed_at":"2026-08-16T17:06:04.267Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.682394] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.268Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c878bb480f011f8a0c8d5276","created_at":"2026-08-16T17:06:03.106Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c083783c7e641bf8e3d72e7337326fc8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.109Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c878bb480f011f8a0c8d5276: start","job_status":"start","queue_duration_s":1.158633,"scheduling_latency_s":1.158651} gitlab # [ 313.697664] gitaly[923]: time="2026-08-16T17:06:04.268Z" level=info msg="burden monitor stats" pid=923 gitlab # [ 313.698903] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.300Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c878bb480f011f8a0c8d5276","created_at":"2026-08-16T17:06:03.106Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c083783c7e641bf8e3d72e7337326fc8","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.109Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c878bb480f011f8a0c8d5276: done: 0.03146 sec","job_status":"done","queue_duration_s":1.158633,"scheduling_latency_s":1.158651,"redis_calls":7,"redis_duration_s":0.001827,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000726,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.03146,"completed_at":"2026-08-16T17:06:04.299Z","load_balancing_strategy":"primary","db_duration_s":0.016036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.739859] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"21fd665756c0a3e68e767956","created_at":"2026-08-16T17:06:03.112Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00a2eecf44a0c1d895ad64a8bb4e18cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.115Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-21fd665756c0a3e68e767956: start","job_status":"start","queue_duration_s":1.185529,"scheduling_latency_s":1.185548} gitlab # [ 313.754284] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.382Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"21fd665756c0a3e68e767956","created_at":"2026-08-16T17:06:03.112Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"00a2eecf44a0c1d895ad64a8bb4e18cf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.115Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-21fd665756c0a3e68e767956: done: 0.081547 sec","job_status":"done","queue_duration_s":1.185529,"scheduling_latency_s":1.185548,"redis_calls":9,"redis_duration_s":0.001657,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000863,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.032,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00050296,"exclusive_lock_hold_duration_s":0.06401224,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.081547,"completed_at":"2026-08-16T17:06:04.382Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.054174,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.797196] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.384Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"622f96f1672e629ec782b19c","created_at":"2026-08-16T17:06:03.123Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8680bbc40a2ba3a8e708872d9964011f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:06:03.127Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-622f96f1672e629ec782b19c: start","job_status":"start","queue_duration_s":1.25648,"scheduling_latency_s":1.256506} gitlab # [ 313.810246] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.395Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 313.813955] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"622f96f1672e629ec782b19c","created_at":"2026-08-16T17:06:03.123Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8680bbc40a2ba3a8e708872d9964011f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-16T17:06:03.127Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-622f96f1672e629ec782b19c: done: 0.017914 sec","job_status":"done","queue_duration_s":1.25648,"scheduling_latency_s":1.256506,"redis_calls":7,"redis_duration_s":0.001294,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000381,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010647,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017914,"completed_at":"2026-08-16T17:06:04.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.855586] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.403Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"34043771627ca0aba57ff443","created_at":"2026-08-16T17:06:03.131Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be897c3caf166ce6a16312d98e9d41ba","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.141Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-34043771627ca0aba57ff443: start","job_status":"start","queue_duration_s":1.261725,"scheduling_latency_s":1.261746} gitlab # [ 313.870883] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.457Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"34043771627ca0aba57ff443","created_at":"2026-08-16T17:06:03.131Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-4fe110ee1d1645a1","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"be897c3caf166ce6a16312d98e9d41ba","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.141Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-34043771627ca0aba57ff443: done: 0.054295 sec","job_status":"done","queue_duration_s":1.261725,"scheduling_latency_s":1.261746,"redis_calls":9,"redis_duration_s":0.0017920000000000002,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000863,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058952,"exclusive_lock_hold_duration_s":0.02646452,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.054295,"completed_at":"2026-08-16T17:06:04.457Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022234,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.915694] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.459Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"19b4c5a15156cbca62fcb43a","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-19b4c5a15156cbca62fcb43a: start","job_status":"start","queue_duration_s":0.886095,"scheduling_latency_s":0.886122} gitlab # [ 313.928324] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.476Z","message":"No existing merge request to be cleaned up."} gitlab # [ 313.929917] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.486Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"19b4c5a15156cbca62fcb43a","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-19b4c5a15156cbca62fcb43a: done: 0.026725 sec","job_status":"done","queue_duration_s":0.886095,"scheduling_latency_s":0.886122,"redis_calls":10,"redis_duration_s":0.001791,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000757,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001034,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026725,"completed_at":"2026-08-16T17:06:04.486Z","load_balancing_strategy":"primary","db_duration_s":0.003086,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 313.968730] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.487Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"166920d0fbb669fad01fb5bd","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-166920d0fbb669fad01fb5bd: start","job_status":"start","queue_duration_s":0.914167,"scheduling_latency_s":0.914189} gitlab # [ 313.980916] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.502Z","message":"No existing merge request to be cleaned up."} gitlab # [ 313.982620] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.513Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"166920d0fbb669fad01fb5bd","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-166920d0fbb669fad01fb5bd: done: 0.026221 sec","job_status":"done","queue_duration_s":0.914167,"scheduling_latency_s":0.914189,"redis_calls":10,"redis_duration_s":0.002735,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001743,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017652,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026221,"completed_at":"2026-08-16T17:06:04.513Z","load_balancing_strategy":"primary","db_duration_s":0.002927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.021606] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.515Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0b12fb7003544c5c6d1a5c33","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0b12fb7003544c5c6d1a5c33: start","job_status":"start","queue_duration_s":0.941758,"scheduling_latency_s":0.941779} gitlab # [ 314.034201] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.528Z","message":"No existing merge request to be cleaned up."} gitlab # [ 314.035853] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.538Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0b12fb7003544c5c6d1a5c33","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0b12fb7003544c5c6d1a5c33: done: 0.022771 sec","job_status":"done","queue_duration_s":0.941758,"scheduling_latency_s":0.941779,"redis_calls":10,"redis_duration_s":0.001489,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000622,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000867,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015415,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.022771,"completed_at":"2026-08-16T17:06:04.538Z","load_balancing_strategy":"primary","db_duration_s":0.003496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.075057] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.539Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9b92ee9b6ec106464dc54d81","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9b92ee9b6ec106464dc54d81: start","job_status":"start","queue_duration_s":0.965764,"scheduling_latency_s":0.965783} gitlab # [ 314.087710] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.551Z","message":"No existing merge request to be cleaned up."} gitlab # [ 314.089518] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.560Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9b92ee9b6ec106464dc54d81","created_at":"2026-08-16T17:06:03.559Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-a3d3f514692e4ce4","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"3cce495d81e6a945b39a01c2903866f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.573Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9b92ee9b6ec106464dc54d81: done: 0.021471 sec","job_status":"done","queue_duration_s":0.965764,"scheduling_latency_s":0.965783,"redis_calls":10,"redis_duration_s":0.001435,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000847,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021471,"completed_at":"2026-08-16T17:06:04.560Z","load_balancing_strategy":"primary","db_duration_s":0.002342,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.129173] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.562Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"499ae74354ad8a001517f222","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-499ae74354ad8a001517f222: start","job_status":"start","queue_duration_s":0.826091,"scheduling_latency_s":0.82611} gitlab # [ 314.141596] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"499ae74354ad8a001517f222","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-499ae74354ad8a001517f222: done: 0.015721 sec","job_status":"done","queue_duration_s":0.826091,"scheduling_latency_s":0.82611,"redis_calls":13,"redis_duration_s":0.0014910000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00054,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015721,"completed_at":"2026-08-16T17:06:04.577Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.181074] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.578Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7aef60dcc2453f69c6dfe2f","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7aef60dcc2453f69c6dfe2f: start","job_status":"start","queue_duration_s":0.842915,"scheduling_latency_s":0.842932} gitlab # [ 314.193399] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.594Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b7aef60dcc2453f69c6dfe2f","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b7aef60dcc2453f69c6dfe2f: done: 0.015282 sec","job_status":"done","queue_duration_s":0.842915,"scheduling_latency_s":0.842932,"redis_calls":13,"redis_duration_s":0.0014789999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015282,"completed_at":"2026-08-16T17:06:04.594Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.232394] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a234a90ccd08557e1b48a2b","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a234a90ccd08557e1b48a2b: start","job_status":"start","queue_duration_s":0.85929,"scheduling_latency_s":0.859308} gitlab # [ 314.244630] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7a234a90ccd08557e1b48a2b","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7a234a90ccd08557e1b48a2b: done: 0.01681 sec","job_status":"done","queue_duration_s":0.85929,"scheduling_latency_s":0.859308,"redis_calls":13,"redis_duration_s":0.001644,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001123,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01681,"completed_at":"2026-08-16T17:06:04.611Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.283304] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.613Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c81703c6ebb70307f5b16378","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c81703c6ebb70307f5b16378: start","job_status":"start","queue_duration_s":0.877177,"scheduling_latency_s":0.877196} gitlab # [ 314.295614] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c81703c6ebb70307f5b16378","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c81703c6ebb70307f5b16378: done: 0.016965 sec","job_status":"done","queue_duration_s":0.877177,"scheduling_latency_s":0.877196,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016965,"completed_at":"2026-08-16T17:06:04.629Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.335516] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9b7bf3cab1aaf8220f3ad3c","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9b7bf3cab1aaf8220f3ad3c: start","job_status":"start","queue_duration_s":0.895258,"scheduling_latency_s":0.895276} gitlab # [ 314.347973] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9b7bf3cab1aaf8220f3ad3c","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9b7bf3cab1aaf8220f3ad3c: done: 0.014944 sec","job_status":"done","queue_duration_s":0.895258,"scheduling_latency_s":0.895276,"redis_calls":13,"redis_duration_s":0.001448,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000546,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014944,"completed_at":"2026-08-16T17:06:04.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.386846] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d28b3c7c8eed3a661b431399","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d28b3c7c8eed3a661b431399: start","job_status":"start","queue_duration_s":0.91127,"scheduling_latency_s":0.911288} gitlab # [ 314.399233] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d28b3c7c8eed3a661b431399","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d28b3c7c8eed3a661b431399: done: 0.015123 sec","job_status":"done","queue_duration_s":0.91127,"scheduling_latency_s":0.911288,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015123,"completed_at":"2026-08-16T17:06:04.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.437911] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92c33e5163a8dbc18bbe34a0","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92c33e5163a8dbc18bbe34a0: start","job_status":"start","queue_duration_s":0.927483,"scheduling_latency_s":0.9275} gitlab # [ 314.450221] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"92c33e5163a8dbc18bbe34a0","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-92c33e5163a8dbc18bbe34a0: done: 0.015066 sec","job_status":"done","queue_duration_s":0.927483,"scheduling_latency_s":0.9275,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010685,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015066,"completed_at":"2026-08-16T17:06:04.678Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.489298] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"955f0b6f96f28294a3d24a9d","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-955f0b6f96f28294a3d24a9d: start","job_status":"start","queue_duration_s":0.943593,"scheduling_latency_s":0.943611} gitlab # [ 314.501824] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"955f0b6f96f28294a3d24a9d","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-955f0b6f96f28294a3d24a9d: done: 0.016619 sec","job_status":"done","queue_duration_s":0.943593,"scheduling_latency_s":0.943611,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016619,"completed_at":"2026-08-16T17:06:04.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.541746] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"007435a628d3653f74163fc0","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-007435a628d3653f74163fc0: start","job_status":"start","queue_duration_s":0.961305,"scheduling_latency_s":0.961323} gitlab # [ 314.553938] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"007435a628d3653f74163fc0","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-007435a628d3653f74163fc0: done: 0.015426 sec","job_status":"done","queue_duration_s":0.961305,"scheduling_latency_s":0.961323,"redis_calls":13,"redis_duration_s":0.001568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000636,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000932,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010851,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015426,"completed_at":"2026-08-16T17:06:04.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.592719] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1795a6899bdfc9c33cd9a4a9","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1795a6899bdfc9c33cd9a4a9: start","job_status":"start","queue_duration_s":0.977794,"scheduling_latency_s":0.977812} gitlab # [ 314.604659] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.728Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1795a6899bdfc9c33cd9a4a9","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1795a6899bdfc9c33cd9a4a9: done: 0.014813 sec","job_status":"done","queue_duration_s":0.977794,"scheduling_latency_s":0.977812,"redis_calls":13,"redis_duration_s":0.001497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010507,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014813,"completed_at":"2026-08-16T17:06:04.728Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.643660] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.729Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2636de978f5cc52d48f35f1","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2636de978f5cc52d48f35f1: start","job_status":"start","queue_duration_s":0.993657,"scheduling_latency_s":0.993674} gitlab # [ 314.655936] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.744Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2636de978f5cc52d48f35f1","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2636de978f5cc52d48f35f1: done: 0.014721 sec","job_status":"done","queue_duration_s":0.993657,"scheduling_latency_s":0.993674,"redis_calls":13,"redis_duration_s":0.001418,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014721,"completed_at":"2026-08-16T17:06:04.744Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.694647] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.746Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5441e10dc35a17dc66b0438","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5441e10dc35a17dc66b0438: start","job_status":"start","queue_duration_s":1.010193,"scheduling_latency_s":1.010211} gitlab # [ 314.707888] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c5441e10dc35a17dc66b0438","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c5441e10dc35a17dc66b0438: done: 0.015142 sec","job_status":"done","queue_duration_s":1.010193,"scheduling_latency_s":1.010211,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015142,"completed_at":"2026-08-16T17:06:04.761Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.748280] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.762Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc94ef389fba6250f2c21801","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc94ef389fba6250f2c21801: start","job_status":"start","queue_duration_s":1.026426,"scheduling_latency_s":1.026444} gitlab # [ 314.760503] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.777Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bc94ef389fba6250f2c21801","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bc94ef389fba6250f2c21801: done: 0.014893 sec","job_status":"done","queue_duration_s":1.026426,"scheduling_latency_s":1.026444,"redis_calls":13,"redis_duration_s":0.001462,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010631,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014893,"completed_at":"2026-08-16T17:06:04.777Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.799646] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91194236bac60fef71d6daad","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91194236bac60fef71d6daad: start","job_status":"start","queue_duration_s":1.04239,"scheduling_latency_s":1.042408} gitlab # [ 314.812533] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"91194236bac60fef71d6daad","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-91194236bac60fef71d6daad: done: 0.01491 sec","job_status":"done","queue_duration_s":1.04239,"scheduling_latency_s":1.042408,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01491,"completed_at":"2026-08-16T17:06:04.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.852411] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d46a5d748474767f48c819aa","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d46a5d748474767f48c819aa: start","job_status":"start","queue_duration_s":1.058422,"scheduling_latency_s":1.05844} gitlab # [ 314.865026] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.809Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d46a5d748474767f48c819aa","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d46a5d748474767f48c819aa: done: 0.015212 sec","job_status":"done","queue_duration_s":1.058422,"scheduling_latency_s":1.05844,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015212,"completed_at":"2026-08-16T17:06:04.809Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.904669] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.811Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8da85c8c5dbda69d6b072d03","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8da85c8c5dbda69d6b072d03: start","job_status":"start","queue_duration_s":1.07564,"scheduling_latency_s":1.075657} gitlab # [ 314.918196] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.826Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8da85c8c5dbda69d6b072d03","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8da85c8c5dbda69d6b072d03: done: 0.015177 sec","job_status":"done","queue_duration_s":1.07564,"scheduling_latency_s":1.075657,"redis_calls":13,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015177,"completed_at":"2026-08-16T17:06:04.826Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 314.958391] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f31aed4356a396784387f7d3","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f31aed4356a396784387f7d3: start","job_status":"start","queue_duration_s":1.091863,"scheduling_latency_s":1.09188} gitlab # [ 314.971093] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f31aed4356a396784387f7d3","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f31aed4356a396784387f7d3: done: 0.015324 sec","job_status":"done","queue_duration_s":1.091863,"scheduling_latency_s":1.09188,"redis_calls":13,"redis_duration_s":0.001514,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00098,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015324,"completed_at":"2026-08-16T17:06:04.843Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.010988] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adccb0e0fee5d5ce7a5fd26d","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adccb0e0fee5d5ce7a5fd26d: start","job_status":"start","queue_duration_s":1.108251,"scheduling_latency_s":1.10827} gitlab # [ 315.023280] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"adccb0e0fee5d5ce7a5fd26d","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-adccb0e0fee5d5ce7a5fd26d: done: 0.015308 sec","job_status":"done","queue_duration_s":1.108251,"scheduling_latency_s":1.10827,"redis_calls":13,"redis_duration_s":0.001492,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015308,"completed_at":"2026-08-16T17:06:04.859Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.063527] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea579b0dda34c10696617b38","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea579b0dda34c10696617b38: start","job_status":"start","queue_duration_s":1.124596,"scheduling_latency_s":1.124613} gitlab # [ 315.076414] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea579b0dda34c10696617b38","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea579b0dda34c10696617b38: done: 0.014983 sec","job_status":"done","queue_duration_s":1.124596,"scheduling_latency_s":1.124613,"redis_calls":13,"redis_duration_s":0.001397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009645,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014983,"completed_at":"2026-08-16T17:06:04.875Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.116057] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39e624be0b0db1d8be552c82","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39e624be0b0db1d8be552c82: start","job_status":"start","queue_duration_s":1.141602,"scheduling_latency_s":1.14162} gitlab # [ 315.129136] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39e624be0b0db1d8be552c82","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39e624be0b0db1d8be552c82: done: 0.015311 sec","job_status":"done","queue_duration_s":1.141602,"scheduling_latency_s":1.14162,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015311,"completed_at":"2026-08-16T17:06:04.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.168029] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.893Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73a566574023ba427b53c069","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73a566574023ba427b53c069: start","job_status":"start","queue_duration_s":1.158016,"scheduling_latency_s":1.158033} gitlab # [ 315.180112] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73a566574023ba427b53c069","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73a566574023ba427b53c069: done: 0.015589 sec","job_status":"done","queue_duration_s":1.158016,"scheduling_latency_s":1.158033,"redis_calls":13,"redis_duration_s":0.001451,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015589,"completed_at":"2026-08-16T17:06:04.909Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.219224] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"462a3ac032732f67098e794d","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-462a3ac032732f67098e794d: start","job_status":"start","queue_duration_s":1.174697,"scheduling_latency_s":1.174714} gitlab # [ 315.232005] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.925Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"462a3ac032732f67098e794d","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-462a3ac032732f67098e794d: done: 0.015202 sec","job_status":"done","queue_duration_s":1.174697,"scheduling_latency_s":1.174714,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010826,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015202,"completed_at":"2026-08-16T17:06:04.925Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.271958] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79e769f3571b3035a2435123","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79e769f3571b3035a2435123: start","job_status":"start","queue_duration_s":1.191002,"scheduling_latency_s":1.191019} gitlab # [ 315.284338] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79e769f3571b3035a2435123","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79e769f3571b3035a2435123: done: 0.016576 sec","job_status":"done","queue_duration_s":1.191002,"scheduling_latency_s":1.191019,"redis_calls":13,"redis_duration_s":0.0014629999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016576,"completed_at":"2026-08-16T17:06:04.943Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.324150] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ef94e5eba27fcbdc05580cf","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ef94e5eba27fcbdc05580cf: start","job_status":"start","queue_duration_s":1.208635,"scheduling_latency_s":1.208652} gitlab # [ 315.337304] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8ef94e5eba27fcbdc05580cf","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8ef94e5eba27fcbdc05580cf: done: 0.015761 sec","job_status":"done","queue_duration_s":1.208635,"scheduling_latency_s":1.208652,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015761,"completed_at":"2026-08-16T17:06:04.960Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.377126] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d62365ec3bf30718874f500","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d62365ec3bf30718874f500: start","job_status":"start","queue_duration_s":1.2255,"scheduling_latency_s":1.225518} gitlab # [ 315.389733] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d62365ec3bf30718874f500","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d62365ec3bf30718874f500: done: 0.014961 sec","job_status":"done","queue_duration_s":1.2255,"scheduling_latency_s":1.225518,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000935,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010616,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014961,"completed_at":"2026-08-16T17:06:04.976Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.429484] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.977Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"294ed7b57756a69c747678cb","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-294ed7b57756a69c747678cb: start","job_status":"start","queue_duration_s":1.241539,"scheduling_latency_s":1.241556} gitlab # [ 315.441814] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"294ed7b57756a69c747678cb","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-294ed7b57756a69c747678cb: done: 0.014941 sec","job_status":"done","queue_duration_s":1.241539,"scheduling_latency_s":1.241556,"redis_calls":13,"redis_duration_s":0.001431,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000492,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000939,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014941,"completed_at":"2026-08-16T17:06:04.992Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.481360] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:04.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ceadc2442b376d5ed8f8ed6","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ceadc2442b376d5ed8f8ed6: start","job_status":"start","queue_duration_s":1.257575,"scheduling_latency_s":1.257593} gitlab # [ 315.493980] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ceadc2442b376d5ed8f8ed6","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ceadc2442b376d5ed8f8ed6: done: 0.015316 sec","job_status":"done","queue_duration_s":1.257575,"scheduling_latency_s":1.257593,"redis_calls":13,"redis_duration_s":0.00143,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015316,"completed_at":"2026-08-16T17:06:05.008Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.534296] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.010Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3452db7b716ae4859a44b135","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3452db7b716ae4859a44b135: start","job_status":"start","queue_duration_s":1.274237,"scheduling_latency_s":1.274256} gitlab # [ 315.546856] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.025Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3452db7b716ae4859a44b135","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3452db7b716ae4859a44b135: done: 0.01513 sec","job_status":"done","queue_duration_s":1.274237,"scheduling_latency_s":1.274256,"redis_calls":13,"redis_duration_s":0.0014750000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01513,"completed_at":"2026-08-16T17:06:05.025Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.586809] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7101002f8fa0309805ca28aa","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7101002f8fa0309805ca28aa: start","job_status":"start","queue_duration_s":1.290446,"scheduling_latency_s":1.290463} gitlab # [ 315.599244] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.041Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7101002f8fa0309805ca28aa","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7101002f8fa0309805ca28aa: done: 0.014836 sec","job_status":"done","queue_duration_s":1.290446,"scheduling_latency_s":1.290463,"redis_calls":13,"redis_duration_s":0.001396,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010518,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014836,"completed_at":"2026-08-16T17:06:05.041Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.638146] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.042Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12412557c66a197bca4440f5","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12412557c66a197bca4440f5: start","job_status":"start","queue_duration_s":1.306389,"scheduling_latency_s":1.306407} gitlab # [ 315.650182] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12412557c66a197bca4440f5","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12412557c66a197bca4440f5: done: 0.015206 sec","job_status":"done","queue_duration_s":1.306389,"scheduling_latency_s":1.306407,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015206,"completed_at":"2026-08-16T17:06:05.057Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.688581] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.059Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79735f2584ff7ff4e7234495","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79735f2584ff7ff4e7234495: start","job_status":"start","queue_duration_s":1.32322,"scheduling_latency_s":1.323238} gitlab # [ 315.700724] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79735f2584ff7ff4e7234495","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79735f2584ff7ff4e7234495: done: 0.014754 sec","job_status":"done","queue_duration_s":1.32322,"scheduling_latency_s":1.323238,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014754,"completed_at":"2026-08-16T17:06:05.073Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.739933] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae7d7608fecbdf650691ed64","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae7d7608fecbdf650691ed64: start","job_status":"start","queue_duration_s":1.339048,"scheduling_latency_s":1.339065} gitlab # [ 315.753208] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.089Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae7d7608fecbdf650691ed64","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae7d7608fecbdf650691ed64: done: 0.014687 sec","job_status":"done","queue_duration_s":1.339048,"scheduling_latency_s":1.339065,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010314,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014687,"completed_at":"2026-08-16T17:06:05.089Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.793168] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.090Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ee6d4e9c1854a2b53904bdf","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ee6d4e9c1854a2b53904bdf: start","job_status":"start","queue_duration_s":1.354836,"scheduling_latency_s":1.354854} gitlab # [ 315.805657] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.105Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ee6d4e9c1854a2b53904bdf","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ee6d4e9c1854a2b53904bdf: done: 0.014572 sec","job_status":"done","queue_duration_s":1.354836,"scheduling_latency_s":1.354854,"redis_calls":13,"redis_duration_s":0.001388,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009682,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014572,"completed_at":"2026-08-16T17:06:05.105Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.844988] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.106Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c3c74150f73e2d463e8c511","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c3c74150f73e2d463e8c511: start","job_status":"start","queue_duration_s":1.370766,"scheduling_latency_s":1.370784} gitlab # [ 315.857441] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.121Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c3c74150f73e2d463e8c511","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c3c74150f73e2d463e8c511: done: 0.014742 sec","job_status":"done","queue_duration_s":1.370766,"scheduling_latency_s":1.370784,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010217,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014742,"completed_at":"2026-08-16T17:06:05.121Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.896370] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.122Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60f6f03661cf14c5f796dacf","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60f6f03661cf14c5f796dacf: start","job_status":"start","queue_duration_s":1.386693,"scheduling_latency_s":1.386712} gitlab # [ 315.908744] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.137Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60f6f03661cf14c5f796dacf","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60f6f03661cf14c5f796dacf: done: 0.014601 sec","job_status":"done","queue_duration_s":1.386693,"scheduling_latency_s":1.386712,"redis_calls":13,"redis_duration_s":0.001477,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014601,"completed_at":"2026-08-16T17:06:05.137Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 315.948774] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.138Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94e75861b1d90b6eb6454d45","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94e75861b1d90b6eb6454d45: start","job_status":"start","queue_duration_s":1.402357,"scheduling_latency_s":1.402375} gitlab # [ 315.960961] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.152Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94e75861b1d90b6eb6454d45","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94e75861b1d90b6eb6454d45: done: 0.014362 sec","job_status":"done","queue_duration_s":1.402357,"scheduling_latency_s":1.402375,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010077,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014362,"completed_at":"2026-08-16T17:06:05.152Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.000106] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.153Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6422890dd3db4ba4be086538","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6422890dd3db4ba4be086538: start","job_status":"start","queue_duration_s":1.417776,"scheduling_latency_s":1.417794} gitlab # [ 316.012472] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6422890dd3db4ba4be086538","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6422890dd3db4ba4be086538: done: 0.014682 sec","job_status":"done","queue_duration_s":1.417776,"scheduling_latency_s":1.417794,"redis_calls":13,"redis_duration_s":0.001394,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014682,"completed_at":"2026-08-16T17:06:05.168Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.051481] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.169Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9daf675b52d7a7901105eccc","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9daf675b52d7a7901105eccc: start","job_status":"start","queue_duration_s":1.433581,"scheduling_latency_s":1.433599} gitlab # [ 316.064089] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.184Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9daf675b52d7a7901105eccc","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9daf675b52d7a7901105eccc: done: 0.014797 sec","job_status":"done","queue_duration_s":1.433581,"scheduling_latency_s":1.433599,"redis_calls":13,"redis_duration_s":0.0015630000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000564,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014797,"completed_at":"2026-08-16T17:06:05.184Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.103295] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea6d5e481347d060df764e7c","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea6d5e481347d060df764e7c: start","job_status":"start","queue_duration_s":1.449465,"scheduling_latency_s":1.449482} gitlab # [ 316.115934] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea6d5e481347d060df764e7c","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea6d5e481347d060df764e7c: done: 0.014515 sec","job_status":"done","queue_duration_s":1.449465,"scheduling_latency_s":1.449482,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010163,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014515,"completed_at":"2026-08-16T17:06:05.199Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.156354] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de0bec81bddc59476acdfe54","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de0bec81bddc59476acdfe54: start","job_status":"start","queue_duration_s":1.465064,"scheduling_latency_s":1.465083} gitlab # [ 316.168354] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de0bec81bddc59476acdfe54","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de0bec81bddc59476acdfe54: done: 0.014987 sec","job_status":"done","queue_duration_s":1.465064,"scheduling_latency_s":1.465083,"redis_calls":13,"redis_duration_s":0.001692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001157,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014987,"completed_at":"2026-08-16T17:06:05.215Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.207574] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"add8e9618ce0e63db22ff3c3","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-add8e9618ce0e63db22ff3c3: start","job_status":"start","queue_duration_s":1.481224,"scheduling_latency_s":1.481242} gitlab # [ 316.220166] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"add8e9618ce0e63db22ff3c3","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-add8e9618ce0e63db22ff3c3: done: 0.015956 sec","job_status":"done","queue_duration_s":1.481224,"scheduling_latency_s":1.481242,"redis_calls":13,"redis_duration_s":0.0015660000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000964,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01082,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015956,"completed_at":"2026-08-16T17:06:05.233Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.259604] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf6402e7a214920149b60312","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf6402e7a214920149b60312: start","job_status":"start","queue_duration_s":1.498265,"scheduling_latency_s":1.498282} gitlab # [ 316.272100] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bf6402e7a214920149b60312","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bf6402e7a214920149b60312: done: 0.015881 sec","job_status":"done","queue_duration_s":1.498265,"scheduling_latency_s":1.498282,"redis_calls":13,"redis_duration_s":0.001777,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000556,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001221,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011271,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015881,"completed_at":"2026-08-16T17:06:05.249Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.311153] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.251Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3332e2ce4fdc7cd9628cca4","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3332e2ce4fdc7cd9628cca4: start","job_status":"start","queue_duration_s":1.515238,"scheduling_latency_s":1.515256} gitlab # [ 316.324247] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3332e2ce4fdc7cd9628cca4","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3332e2ce4fdc7cd9628cca4: done: 0.014345 sec","job_status":"done","queue_duration_s":1.515238,"scheduling_latency_s":1.515256,"redis_calls":13,"redis_duration_s":0.0014,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014345,"completed_at":"2026-08-16T17:06:05.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.365273] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0964fa7777b3c6ad9ad5e72","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0964fa7777b3c6ad9ad5e72: start","job_status":"start","queue_duration_s":1.53065,"scheduling_latency_s":1.530666} gitlab # [ 316.377646] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a0964fa7777b3c6ad9ad5e72","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a0964fa7777b3c6ad9ad5e72: done: 0.014608 sec","job_status":"done","queue_duration_s":1.53065,"scheduling_latency_s":1.530666,"redis_calls":13,"redis_duration_s":0.001564,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000997,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014608,"completed_at":"2026-08-16T17:06:05.281Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.416116] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af8d5982890d412ffd081998","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af8d5982890d412ffd081998: start","job_status":"start","queue_duration_s":1.546693,"scheduling_latency_s":1.546711} gitlab # [ 316.428149] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"af8d5982890d412ffd081998","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-af8d5982890d412ffd081998: done: 0.016496 sec","job_status":"done","queue_duration_s":1.546693,"scheduling_latency_s":1.546711,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016496,"completed_at":"2026-08-16T17:06:05.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.467120] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.300Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a2188062375a41fcdcf3166","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a2188062375a41fcdcf3166: start","job_status":"start","queue_duration_s":1.564245,"scheduling_latency_s":1.564263} gitlab # [ 316.479748] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.314Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a2188062375a41fcdcf3166","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a2188062375a41fcdcf3166: done: 0.01464 sec","job_status":"done","queue_duration_s":1.564245,"scheduling_latency_s":1.564263,"redis_calls":13,"redis_duration_s":0.0016120000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01464,"completed_at":"2026-08-16T17:06:05.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.518816] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.315Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9615ec12cd235b22d96519c4","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9615ec12cd235b22d96519c4: start","job_status":"start","queue_duration_s":1.57995,"scheduling_latency_s":1.579968} gitlab # [ 316.530942] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.330Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9615ec12cd235b22d96519c4","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9615ec12cd235b22d96519c4: done: 0.014574 sec","job_status":"done","queue_duration_s":1.57995,"scheduling_latency_s":1.579968,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014574,"completed_at":"2026-08-16T17:06:05.330Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.570714] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.331Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"051b68bfb8e242db89e44a80","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-051b68bfb8e242db89e44a80: start","job_status":"start","queue_duration_s":1.595573,"scheduling_latency_s":1.59559} gitlab # [ 316.583108] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.346Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"051b68bfb8e242db89e44a80","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-051b68bfb8e242db89e44a80: done: 0.014547 sec","job_status":"done","queue_duration_s":1.595573,"scheduling_latency_s":1.59559,"redis_calls":13,"redis_duration_s":0.00139,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00089,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009889,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014547,"completed_at":"2026-08-16T17:06:05.345Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.623046] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d865e21ac3cf257e7e5b089","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d865e21ac3cf257e7e5b089: start","job_status":"start","queue_duration_s":1.611251,"scheduling_latency_s":1.611268} gitlab # [ 316.635565] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d865e21ac3cf257e7e5b089","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d865e21ac3cf257e7e5b089: done: 0.014482 sec","job_status":"done","queue_duration_s":1.611251,"scheduling_latency_s":1.611268,"redis_calls":13,"redis_duration_s":0.0014169999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014482,"completed_at":"2026-08-16T17:06:05.361Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 316.674674] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d737941b31d0d8a94fe93ac4","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d737941b31d0d8a94fe93ac4: start","job_status":"start","queue_duration_s":1.626842,"scheduling_latency_s":1.626859} gitlab # [ 316.686992] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:05.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d737941b31d0d8a94fe93ac4","created_at":"2026-08-16T17:06:03.660Z","trace_propagation_headers":{"sentry-trace":"81c2e3cf50254888bd1503d920d3e626-67fcabcfe0dc43f6","baggage":"sentry-trace_id=81c2e3cf50254888bd1503d920d3e626,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"5329b0362bead33505d2c5acdf7785e4","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:03.735Z","job_size_bytes":2,"pid":2139,"sidekiq_tid":"m7n7","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d737941b31d0d8a94fe93ac4: done: 0.014424 sec","job_status":"done","queue_duration_s":1.626842,"scheduling_latency_s":1.626859,"redis_calls":13,"redis_duration_s":0.001406,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014424,"completed_at":"2026-08-16T17:06:05.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 329.469799] postgres[3394]: [3394] ERROR: relation "table_without_models" does not exist gitlab # [ 329.470315] postgres[3394]: [3394] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 335.274017] runuser[3063]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 335.275660] setup-gitlab-start[3033]: + systemctl restart gitlab-sidekiq.service gitlab # [ 335.314879] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 335.320228] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:25.985Z","message":"Shutting down"} gitlab # [ 335.322012] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:25.987Z","message":"Scheduler exiting..."} gitlab # [ 335.323786] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:25.988Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 335.326028] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:25.988Z","message":"Scheduler exiting..."} gitlab # [ 335.824965] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:26.490Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 340.335017] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:30.999Z","message":"Bye!"} gitlab # [ 341.310742] sidekiq-cluster[2139]: {"severity":"INFO","time":"2026-08-16T17:06:31.976Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2139,"worker_id":"sidekiq_0","memwd_rss_bytes":952401920,"retry":0} gitlab # [ 342.013472] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 342.013869] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 342.014146] systemd[1]: gitlab-sidekiq.service: Consumed 1min 52.795s CPU time over 3min 22.929s wall clock time, 947.3M memory peak, 4.5M read from disk. gitlab # [ 342.027686] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 342.032266] setup-gitlab-start[3033]: + mkdir -p /var/lib/secrets gitlab # [ 342.036719] setup-gitlab-start[3033]: + echo nixbot-test-token-of-20-chars gitlab # [ 342.039599] setup-gitlab-start[3033]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 342.042753] setup-gitlab-start[3033]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 344.348151] gitaly[923]: time="2026-08-16T17:06:35.012Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:44.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.011" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.378738] gitaly[923]: time="2026-08-16T17:06:35.012Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:44.000" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.011" grpc.time_ms=0.632 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.766018] gitaly[923]: time="2026-08-16T17:06:35.431Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.431" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.826187] gitaly[923]: time="2026-08-16T17:06:35.431Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.010" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.431" grpc.time_ms=0.631 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.908254] gitaly[923]: time="2026-08-16T17:06:35.574Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD diskcache=416ad49d-3263-40d1-a8ae-f90f72d7513a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:45.085" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.505" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.939758] gitaly[923]: time="2026-08-16T17:06:35.574Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=37 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1439 command.oublock=32 command.real_time_ms=43 command.spawn_token_fork_ms=5 command.system_time_ms=31 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:45.085" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.505" grpc.time_ms=68.64 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.972295] gitaly[923]: time="2026-08-16T17:06:35.616Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.194" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.615" pid=923 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 344.990086] gitaly[923]: time="2026-08-16T17:06:35.617Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.194" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.615" grpc.time_ms=1.266 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 345.005076] gitaly[923]: time="2026-08-16T17:06:35.650Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:45.212" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.633" grpc.time_ms=16.523 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 345.159262] gitaly[923]: time="2026-08-16T17:06:35.825Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.824" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 345.190971] gitaly[923]: time="2026-08-16T17:06:35.825Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.004" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.824" grpc.time_ms=0.599 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 345.221970] gitaly[923]: time="2026-08-16T17:06:35.868Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD diskcache=f6d3fa46-96a8-4eb5-aeee-6483d7c01e72 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:45.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.828" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 345.242577] gitaly[923]: time="2026-08-16T17:06:35.868Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1440 command.oublock=32 command.real_time_ms=18 command.spawn_token_fork_ms=5 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-16T17:06:45.007" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.828" grpc.time_ms=39.687 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 345.262884] gitaly[923]: time="2026-08-16T17:06:35.888Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.066" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.887" pid=923 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 345.276472] gitaly[923]: time="2026-08-16T17:06:35.889Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.066" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.887" grpc.time_ms=1.367 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 345.288646] gitaly[923]: time="2026-08-16T17:06:35.906Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:45.075" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.896" grpc.time_ms=10.254 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 345.329665] gitaly[923]: time="2026-08-16T17:06:35.995Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:06:45.174" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:35.994" grpc.time_ms=0.617 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 345.360217] gitaly[923]: time="2026-08-16T17:06:36.025Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:06:46.003" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:36.024" grpc.time_ms=0.771 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 347.203154] gitaly[923]: time="2026-08-16T17:06:37.867Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RM44ZGEG0WV94ADF802CD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:47.029" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:37.849" grpc.time_ms=17.929 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 347.376418] sidekiq-cluster[3473]: {"severity":"INFO","time":"2026-08-16T17:06:38.013Z","message":"Starting cluster with 1 processes"} gitlab # [ 347.874601] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:38 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 5803 gitlab # [ 347.881419] setup-gitlab-start[3033]: + mkdir -p /tmp/test-flake gitlab # [ 347.884451] setup-gitlab-start[3033]: + cd /tmp/test-flake gitlab # [ 347.886730] setup-gitlab-start[3033]: + git init -b master gitlab # [ 347.909953] setup-gitlab-start[3538]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 347.913572] setup-gitlab-start[3033]: + git config user.name test gitlab # [ 347.916980] setup-gitlab-start[3033]: + git config user.email test@example.com gitlab # [ 347.923556] setup-gitlab-start[3033]: + cat gitlab # [ 347.928273] setup-gitlab-start[3033]: + git add flake.nix gitlab # [ 347.934915] setup-gitlab-start[3033]: + git commit -m 'initial commit' gitlab # [ 347.960145] setup-gitlab-start[3543]: [master (root-commit) 3139bc2] initial commit gitlab # [ 347.963076] setup-gitlab-start[3543]: 1 file changed, 10 insertions(+) gitlab # [ 347.965649] setup-gitlab-start[3543]: create mode 100644 flake.nix gitlab # [ 347.967996] setup-gitlab-start[3033]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 347.976360] setup-gitlab-start[3033]: + git push -u origin master gitlab # [ 348.103194] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:38 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 81 gitlab # [ 348.327609] gitaly[923]: time="2026-08-16T17:06:38.992Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA1J8SWFT2GXVY838YFP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:38.975" grpc.time_ms=16.689 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 348.352618] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:39 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 247 gitlab # [ 349.273854] gitaly[923]: time="2026-08-16T17:06:39.939Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:49.001" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:39.921" grpc.time_ms=17.912 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 349.336552] gitaly[923]: time="2026-08-16T17:06:40.001Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T17:07:09.089" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T17:06:39.990" grpc.time_ms=10.836 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 349.419885] gitaly[923]: time="2026-08-16T17:06:40.085Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF duration_ms=751ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 349.501000] gitaly[923]: time="2026-08-16T17:06:40.166Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF duration_ms=79ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 349.513889] gitaly[923]: time="2026-08-16T17:06:40.167Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:39.331" grpc.time_ms=835.785 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 349.565229] gitaly[923]: time="2026-08-16T17:06:40.231Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:40.228" grpc.time_ms=2.002 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 349.627829] gitaly[923]: time="2026-08-16T17:06:40.293Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:40.292" grpc.time_ms=1.271 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 349.691884] gitaly[923]: time="2026-08-16T17:06:40.357Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:40.356" grpc.time_ms=0.866 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 349.872274] gitaly[923]: time="2026-08-16T17:06:40.538Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:06:50.099" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:40.520" grpc.time_ms=17.528 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 349.924179] gitaly[923]: time="2026-08-16T17:06:40.590Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1434 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T17:06:50.143" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:40.564" grpc.time_ms=25.498 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 349.963484] gitaly[923]: time="2026-08-16T17:06:40.629Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF duration_ms=218ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 349.970878] gitaly[923]: time="2026-08-16T17:06:40.630Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:40.408" grpc.time_ms=221.082 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 349.992759] gitaly[923]: time="2026-08-16T17:06:40.641Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF diskcache=98f537ca-3f06-4e6b-8cd3-1f70b3c804cb grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:39.200" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 350.012779] systemd[1]: Finished setup-gitlab.service. gitlab # [ 350.014583] gitlab-workhorse[825]: time="2026-08-16T17:06:40Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 350.017814] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:40 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1603 gitlab # [ 350.021054] setup-gitlab-start[3547]: To http://gitlab/root/test-flake.git gitlab # [ 350.022491] setup-gitlab-start[3547]: * [new branch] master -> master gitlab # [ 350.023813] setup-gitlab-start[3547]: branch 'master' set up to track 'origin/master'. gitlab # [ 350.025435] gitaly[923]: time="2026-08-16T17:06:40.641Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=389 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13639 command.oublock=32 command.real_time_ms=1431 command.spawn_token_fork_ms=2 command.system_time_ms=232 command.user_time_ms=157 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:39.200" grpc.time_ms=1441.013 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 350.043519] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 350.91 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 351.381123] nixbot[3635]: {"ts": "2026-08-16T17:06:42.046Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 351.405547] nixbot[3635]: {"ts": "2026-08-16T17:06:42.071Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 351.449429] nixbot[3635]: {"ts": "2026-08-16T17:06:42.115Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 351.458665] nixbot[3635]: {"ts": "2026-08-16T17:06:42.124Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 351.465925] nixbot[3635]: {"ts": "2026-08-16T17:06:42.131Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 351.478372] nixbot[3635]: {"ts": "2026-08-16T17:06:42.144Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 351.491876] nixbot[3635]: {"ts": "2026-08-16T17:06:42.157Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 351.496205] nixbot[3635]: {"ts": "2026-08-16T17:06:42.161Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 351.508157] nixbot[3635]: {"ts": "2026-08-16T17:06:42.173Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 351.515540] nixbot[3635]: {"ts": "2026-08-16T17:06:42.178Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 351.522599] nixbot[3635]: {"ts": "2026-08-16T17:06:42.188Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 351.535375] nixbot[3635]: {"ts": "2026-08-16T17:06:42.201Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 351.541323] nixbot[3635]: {"ts": "2026-08-16T17:06:42.207Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 351.546565] nixbot[3635]: {"ts": "2026-08-16T17:06:42.210Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 351.552352] nixbot[3635]: {"ts": "2026-08-16T17:06:42.218Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 351.557585] nixbot[3635]: {"ts": "2026-08-16T17:06:42.221Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 351.562747] nixbot[3635]: {"ts": "2026-08-16T17:06:42.224Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 351.567790] nixbot[3635]: {"ts": "2026-08-16T17:06:42.227Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 351.572584] nixbot[3635]: {"ts": "2026-08-16T17:06:42.235Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 351.577128] nixbot[3635]: {"ts": "2026-08-16T17:06:42.238Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 351.581553] nixbot[3635]: {"ts": "2026-08-16T17:06:42.241Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 351.585624] nixbot[3635]: {"ts": "2026-08-16T17:06:42.250Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 351.589910] nixbot[3635]: {"ts": "2026-08-16T17:06:42.253Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 351.594208] nixbot[3635]: {"ts": "2026-08-16T17:06:42.257Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 351.598285] nixbot[3635]: {"ts": "2026-08-16T17:06:42.259Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 352.113316] nixbot[3635]: INFO: Started server process [3635] gitlab # [ 352.116055] nixbot[3635]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 352.133395] nixbot[3635]: INFO: ::ffff:127.0.0.1:39808 - "GET /health HTTP/1.1" 200 OK gitlab # [ 352.143626] systemd[1]: Started nixbot CI service. gitlab # [ 352.148724] systemd[1]: Reached target Multi-User System. gitlab # [ 352.151302] systemd[1]: Startup finished in 997ms (kernel) + 4.626s (initrd) + 5min 46.527s (userspace) = 5min 52.151s. gitlab # [ 352.441206] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:43 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 306 gitlab # [ 352.449323] nixbot[3635]: {"ts": "2026-08-16T17:06:43.107Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 352.479128] nixbot[3635]: {"ts": "2026-08-16T17:06:43.145Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab: (finished: waiting for unit nixbot.service, in 2.14 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 352.605230] nixbot[3635]: INFO: ::ffff:127.0.0.1:35154 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 352.715331] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 226 gitlab # [ 352.719265] nixbot[3635]: {"ts": "2026-08-16T17:06:43.384Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 352.723454] nixbot[3635]: {"ts": "2026-08-16T17:06:43.389Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 352.730631] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:43 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 80 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.12 seconds) gitlab # [ 352.978587] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 249 gitlab # [ 352.980814] nixbot[3635]: {"ts": "2026-08-16T17:06:43.646Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 353.964681] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 176 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.23 seconds) (finished: subtest: project discovered and webhook registered, in 1.36 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 354.069426] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 38 gitlab # [ 354.165085] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:44 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 202 "" "git/2.55.0" 91 gitlab # [ 354.167975] gitaly[923]: time="2026-08-16T17:06:44.830Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMFW3RFP6ZJYCH11MKN38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:44.819" grpc.time_ms=10.239 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 354.182366] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:44 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1177 gitlab # [ 354.185328] nixbot[3635]: {"ts": "2026-08-16T17:06:44.845Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 91.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 354.268109] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 67 gitlab # [ 354.272194] nixbot[3635]: {"ts": "2026-08-16T17:06:44.937Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 354.349012] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:45 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 73 gitlab # [ 354.353393] nixbot[3635]: {"ts": "2026-08-16T17:06:45.016Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 354.448454] gitaly[923]: time="2026-08-16T17:06:45.114Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=10 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG50G6V7NJJZTHQ9NYPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-16T17:07:15.085" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:45.086" grpc.time_ms=27.025 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 354.489455] gitaly[923]: time="2026-08-16T17:06:45.155Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG50G6V7NJJZTHQ9NYPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:15.152" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:45.153" grpc.time_ms=1.221 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 354.514965] gitaly[923]: time="2026-08-16T17:06:45.180Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG50G6V7NJJZTHQ9NYPN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-16T17:06:55.145" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:45.165" grpc.time_ms=14.61 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 354.553226] gitaly[923]: time="2026-08-16T17:06:45.219Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=7 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-16T17:07:15.009" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-16T17:06:45.209" grpc.time_ms=9.457 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 354.575787] gitaly[923]: time="2026-08-16T17:06:45.232Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M05RMG0NSRS5JN7G076JGYE8 duration_ms=116ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 354.608164] gitaly[923]: time="2026-08-16T17:06:45.274Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M05RMG0NSRS5JN7G076JGYE8 duration_ms=41ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 354.613439] gitaly[923]: time="2026-08-16T17:06:45.274Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:45.114" grpc.time_ms=159.508 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 354.631479] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 255 gitlab # [ 354.635270] nixbot[3635]: {"ts": "2026-08-16T17:06:45.281Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # [ 354.655340] gitaly[923]: time="2026-08-16T17:06:45.321Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:45.320" grpc.time_ms=0.516 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 354.698092] gitaly[923]: time="2026-08-16T17:06:45.364Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:45.361" grpc.time_ms=2.204 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 354.729043] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 109 gitlab # [ 354.733274] nixbot[3635]: {"ts": "2026-08-16T17:06:45.396Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 354.737693] nixbot[3635]: {"ts": "2026-08-16T17:06:45.400Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 354.754940] gitaly[923]: time="2026-08-16T17:06:45.421Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:45.419" grpc.time_ms=0.867 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 354.851529] gitaly[923]: time="2026-08-16T17:06:45.517Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMGHYWZGEM8E4NEK5H457 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.508" grpc.time_ms=8.672 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 354.868238] gitaly[923]: time="2026-08-16T17:06:45.519Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M05RMG0NSRS5JN7G076JGYE8 duration_ms=55ns method=POST pid=923 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 354.871499] gitaly[923]: time="2026-08-16T17:06:45.519Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:45.463" grpc.time_ms=56.367 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # To http://gitlab/root/test-flake.git gitlab # [ 354.883631] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:45 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 79 gitlab # 3139bc2..4d08eaf [ 354.886439] gitlab-workhorse[825]: time="2026-08-16T17:06:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # master -> master[ 354.888660] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:45 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 656 gitlab # gitlab # [ 354.890762] gitaly[923]: time="2026-08-16T17:06:45.541Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 diskcache=fadb2520-1d93-40e1-81eb-461ce21c7a9e grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.011" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 0.94 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab # [ 354.901631] gitaly[923]: time="2026-08-16T17:06:45.541Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=223 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13664 command.oublock=32 command.real_time_ms=520 command.spawn_token_fork_ms=2 command.system_time_ms=141 command.user_time_ms=82 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.011" grpc.time_ms=530.025 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.01 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 355.005107] nixbot[3635]: INFO: ::ffff:127.0.0.1:35164 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.09 seconds) gitlab # [ 355.130954] gitaly[923]: time="2026-08-16T17:06:45.795Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMGMGFY0KQCHHFQ9A431V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.780" pid=923 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 355.159562] gitaly[923]: time="2026-08-16T17:06:45.795Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMGMGFY0KQCHHFQ9A431V grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.780" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 355.189267] gitlab-workhorse[825]: time="2026-08-16T17:06:45Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 355.193667] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:45 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 305 gitlab # [ 355.198256] gitaly[923]: time="2026-08-16T17:06:45.795Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMGMGFY0KQCHHFQ9A431V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.780" grpc.time_ms=15.381 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 355.355222] gitaly[923]: time="2026-08-16T17:06:46.021Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMGY8N8P49KTW0292C1VM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.984" pid=923 remote_ip="2001:db8:1::1" request_sha=d630315ceaf951808c1d698a839c7caca868d650 response_bytes=417 span.kind=server system=grpc gitlab # [ 355.377162] gitaly[923]: time="2026-08-16T17:06:46.021Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1131 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=1 command.system_time_ms=27 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMGY8N8P49KTW0292C1VM grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.984" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 355.401846] gitlab-workhorse[825]: time="2026-08-16T17:06:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=417 gitlab # [ 355.405849] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 417 "" "git/2.55.0" 190 gitlab # [ 355.409137] gitaly[923]: time="2026-08-16T17:06:46.021Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=30 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1131 command.oublock=0 command.real_time_ms=33 command.spawn_token_fork_ms=1 command.system_time_ms=27 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMGY8N8P49KTW0292C1VM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:45.984" grpc.time_ms=36.88 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 355.538995] gitaly[923]: time="2026-08-16T17:06:46.204Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMH6A2M5QNZKM598N1NN2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.186" grpc.time_ms=17.874 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 355.576244] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 116 gitlab # [ 355.665361] gitaly[923]: time="2026-08-16T17:06:46.331Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHA1C6RT8WJEEK9BXM38 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.312" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 355.694842] gitaly[923]: time="2026-08-16T17:06:46.331Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHA1C6RT8WJEEK9BXM38 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.312" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 355.720817] gitlab-workhorse[825]: time="2026-08-16T17:06:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 355.723655] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 122 gitlab # [ 355.726824] gitaly[923]: time="2026-08-16T17:06:46.331Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHA1C6RT8WJEEK9BXM38 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.312" grpc.time_ms=19.061 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 355.858350] gitaly[923]: time="2026-08-16T17:06:46.524Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMHG3G1A9J2Z6HX9K6EKY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.506" grpc.time_ms=17.952 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 355.896463] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:46 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 122 gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 356.010799] gitaly[923]: time="2026-08-16T17:06:46.676Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHM1M2QNNJQNKXP0V5PX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.644" pid=923 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 356.044991] gitaly[923]: time="2026-08-16T17:06:46.676Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=1 command.system_time_ms=23 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHM1M2QNNJQNKXP0V5PX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.644" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 356.078146] gitlab-workhorse[825]: time="2026-08-16T17:06:46Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 356.082640] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:46 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 148 gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.09 seconds) gitlab # [ 356.086673] gitaly[923]: time="2026-08-16T17:06:46.677Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1103 command.oublock=0 command.real_time_ms=28 command.spawn_token_fork_ms=1 command.system_time_ms=23 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHM1M2QNNJQNKXP0V5PX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:46.644" grpc.time_ms=32.284 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 356.117480] nixbot[3635]: INFO: ::ffff:127.0.0.1:35172 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab # [ 356.204333] gitaly[923]: time="2026-08-16T17:06:46.869Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:16.667" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:46.867" grpc.time_ms=1.146 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 356.312332] gitaly[923]: time="2026-08-16T17:06:46.978Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T17:07:16.057" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:46.958" grpc.time_ms=19.764 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 356.358628] gitaly[923]: time="2026-08-16T17:06:47.024Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=6 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:57.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:47.008" grpc.time_ms=16.198 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 356.394633] gitaly[923]: time="2026-08-16T17:06:47.060Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:06:57.042" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:47.043" grpc.time_ms=17.169 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 356.531957] gitaly[923]: time="2026-08-16T17:06:47.197Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:06:57.196" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:47.197" grpc.time_ms=0.645 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 356.598591] gitaly[923]: time="2026-08-16T17:06:47.264Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:06:57.245" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:47.246" grpc.time_ms=17.763 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 356.671556] gitaly[923]: time="2026-08-16T17:06:47.337Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:47.336" grpc.time_ms=0.994 pid=923 span.kind=server system=grpc gitlab # [ 356.755786] gitaly[923]: time="2026-08-16T17:06:47.421Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:06:47.420" grpc.time_ms=0.773 pid=923 span.kind=server system=grpc gitlab # [ 356.785323] gitaly[923]: time="2026-08-16T17:06:47.436Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB diskcache=b0d93ac1-a42c-4d4b-8990-0fa2b77b2e8f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:06:57.268" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:47.269" pid=923 ref=refs/keep-around/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 remote_ip="2001:db8:1::1" revision=3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 span.kind=server system=grpc username=root gitlab # [ 356.810891] gitaly[923]: time="2026-08-16T17:06:47.436Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=140 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5529 command.oublock=8 command.real_time_ms=159 command.spawn_token_fork_ms=2 command.system_time_ms=88 command.user_time_ms=52 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:06:57.268" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:06:47.269" grpc.time_ms=166.877 pid=923 ref=refs/keep-around/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 remote_ip="2001:db8:1::1" revision=3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 span.kind=server system=grpc username=root gitlab # [ 356.835366] gitaly[923]: time="2026-08-16T17:06:47.443Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:17.242" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:47.442" grpc.time_ms=0.794 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 357.134332] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:47 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 1056 gitlab # [ 357.143473] nixbot[3635]: {"ts": "2026-08-16T17:06:47.803Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""} gitlab # [ 357.158245] nixbot[3635]: {"ts": "2026-08-16T17:06:47.824Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-3139bc27e7fc-0"} gitlab # [ 357.165574] nixbot[3635]: INFO: ::ffff:127.0.0.1:35188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.07 seconds) gitlab # [ 357.258299] systemd[1]: Started Nix Daemon. gitlab # [ 357.362960] nix-daemon[3858]: accepted connection from pid 3852, user nixbot gitlab # [ 357.483965] nix-daemon[3858]: accepted connection from pid 3865, user nixbot gitlab # [ 357.508224] nixbot[3635]: {"ts": "2026-08-16T17:06:48.173Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-3139bc27e7fc-0", "argv0": "bwrap"} gitlab # [ 357.747393] nix-daemon[3858]: accepted connection from pid 3875, user nixbot gitlab # [ 357.830536] nix-daemon[3858]: accepted connection from pid 3885, user nixbot gitlab # [ 357.849470] nix-daemon[3858]: accepted connection from pid 3875, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab # [ 358.225191] nixbot[3635]: INFO: ::ffff:127.0.0.1:35190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 359.281818] nixbot[3635]: INFO: ::ffff:127.0.0.1:35204 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 360.347936] nixbot[3635]: INFO: ::ffff:127.0.0.1:35220 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 361.402301] nixbot[3635]: INFO: ::ffff:127.0.0.1:48236 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 362.456079] nixbot[3635]: INFO: ::ffff:127.0.0.1:48242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab # [ 362.516812] gitaly[923]: time="2026-08-16T17:06:53.179Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMR01APR95NWQDF5MJWTW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:23.077" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:53.178" grpc.time_ms=1.401 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 362.590454] gitaly[923]: time="2026-08-16T17:06:53.256Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05RMR01APR95NWQDF5MJWTW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:03.237" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:53.238" grpc.time_ms=18.005 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 362.737081] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:53 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 343 gitlab # [ 362.745137] nixbot[3635]: {"ts": "2026-08-16T17:06:53.404Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""} gitlab # [ 362.862670] gitaly[923]: time="2026-08-16T17:06:53.528Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMRB48QR6RHQCR9R7NFTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:23.526" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:53.527" grpc.time_ms=1.173 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 363.078510] gitaly[923]: time="2026-08-16T17:06:53.744Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M05RMRB48QR6RHQCR9R7NFTT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:03.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:53.726" grpc.time_ms=17.655 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 363.246069] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:53 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 498 gitlab # [ 363.249750] nixbot[3635]: {"ts": "2026-08-16T17:06:53.914Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""} gitlab # [ 363.382463] gitaly[923]: time="2026-08-16T17:06:54.048Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMRVCXSAADVMHDG8RR9FD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:07:24.045" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:06:54.046" grpc.time_ms=1.341 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 363.453863] gitaly[923]: time="2026-08-16T17:06:54.119Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMRVCXSAADVMHDG8RR9FD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:07:04.082" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:06:54.102" grpc.time_ms=16.842 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.08 seconds) gitlab # [ 363.535828] nixbot[3635]: INFO: ::ffff:127.0.0.1:48252 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab # [ 363.571665] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:54 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 304 gitlab # [ 363.580993] nixbot[3635]: {"ts": "2026-08-16T17:06:54.239Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""} gitlab # [ 363.736522] nix-daemon[3858]: accepted connection from pid 3933, user nixbot gitlab # [ 363.923662] gitaly[923]: time="2026-08-16T17:06:54.587Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMSCJPP2T546T4E1NDF9W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.571" grpc.time_ms=15.843 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 363.964528] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 106 gitlab # [ 364.101321] gitaly[923]: time="2026-08-16T17:06:54.767Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSH658F90RTYNQQD2X83 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.747" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 364.129432] gitaly[923]: time="2026-08-16T17:06:54.767Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSH658F90RTYNQQD2X83 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.747" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 364.157241] gitlab-workhorse[825]: time="2026-08-16T17:06:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 364.160452] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:06:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 137 gitlab # [ 364.163539] gitaly[923]: time="2026-08-16T17:06:54.767Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMSH658F90RTYNQQD2X83 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:06:54.747" grpc.time_ms=20.142 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 364.264435] nix-daemon[3858]: accepted connection from pid 3958, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab # [ 364.596329] nixbot[3635]: INFO: ::ffff:127.0.0.1:48260 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 365.648599] nixbot[3635]: INFO: ::ffff:127.0.0.1:48266 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 366.704454] nixbot[3635]: INFO: ::ffff:127.0.0.1:48272 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 367.760688] nixbot[3635]: INFO: ::ffff:127.0.0.1:48274 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 368.821867] nixbot[3635]: INFO: ::ffff:127.0.0.1:48286 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 369.877361] nixbot[3635]: INFO: ::ffff:127.0.0.1:48296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 370.931631] nixbot[3635]: INFO: ::ffff:127.0.0.1:54854 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 371.985783] nixbot[3635]: INFO: ::ffff:127.0.0.1:54862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 373.037854] nixbot[3635]: INFO: ::ffff:127.0.0.1:54878 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 374.092920] nixbot[3635]: INFO: ::ffff:127.0.0.1:54890 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 375.148716] nixbot[3635]: INFO: ::ffff:127.0.0.1:54902 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 376.200883] nixbot[3635]: INFO: ::ffff:127.0.0.1:54914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 377.251991] nixbot[3635]: INFO: ::ffff:127.0.0.1:54928 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 378.306191] nixbot[3635]: INFO: ::ffff:127.0.0.1:54936 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 379.358101] nixbot[3635]: INFO: ::ffff:127.0.0.1:54950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 380.412325] nixbot[3635]: INFO: ::ffff:127.0.0.1:54956 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 381.465843] nixbot[3635]: INFO: ::ffff:127.0.0.1:38920 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 382.520542] nixbot[3635]: INFO: ::ffff:127.0.0.1:38936 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 383.574832] nixbot[3635]: INFO: ::ffff:127.0.0.1:38938 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 384.627699] nixbot[3635]: INFO: ::ffff:127.0.0.1:38944 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 385.679599] nixbot[3635]: INFO: ::ffff:127.0.0.1:38950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 386.734984] nixbot[3635]: INFO: ::ffff:127.0.0.1:38966 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 387.784441] sidekiq-cluster[3532]: 2026-08-16T17:07:18.449Z pid=3532 tid=yn8 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3532, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>425975808} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 387.788296] nixbot[3635]: INFO: ::ffff:127.0.0.1:38970 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab # [ 388.053177] sidekiq-cluster[3532]: W, [2026-08-16T17:07:18.719029 #3532] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 388.187331] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:07:18.853Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 388.843791] nixbot[3635]: INFO: ::ffff:127.0.0.1:38972 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 389.896868] nixbot[3635]: INFO: ::ffff:127.0.0.1:38986 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 390.954557] nixbot[3635]: INFO: ::ffff:127.0.0.1:49832 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab # [ 391.151429] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:07:21.816Z","message":"GitLab reliable fetch activated!"} gitlab # [ 391.156883] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:07:21.816Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 392.012268] nixbot[3635]: INFO: ::ffff:127.0.0.1:49836 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 393.072764] nixbot[3635]: INFO: ::ffff:127.0.0.1:49848 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 394.133011] nixbot[3635]: INFO: ::ffff:127.0.0.1:49850 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 395.192631] nixbot[3635]: INFO: ::ffff:127.0.0.1:49856 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 396.248443] nixbot[3635]: INFO: ::ffff:127.0.0.1:49866 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 397.302955] nixbot[3635]: INFO: ::ffff:127.0.0.1:49872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 398.357480] nixbot[3635]: INFO: ::ffff:127.0.0.1:49884 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 399.411489] nixbot[3635]: INFO: ::ffff:127.0.0.1:49888 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 400.465503] nixbot[3635]: INFO: ::ffff:127.0.0.1:49890 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 401.520210] nixbot[3635]: INFO: ::ffff:127.0.0.1:53202 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 402.574853] nixbot[3635]: INFO: ::ffff:127.0.0.1:53216 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 403.629792] nixbot[3635]: INFO: ::ffff:127.0.0.1:53226 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 404.682760] nixbot[3635]: INFO: ::ffff:127.0.0.1:53238 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 405.738732] nixbot[3635]: INFO: ::ffff:127.0.0.1:53242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 406.792647] nixbot[3635]: INFO: ::ffff:127.0.0.1:53252 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 407.847680] nixbot[3635]: INFO: ::ffff:127.0.0.1:53258 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 408.906940] nixbot[3635]: INFO: ::ffff:127.0.0.1:53260 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab # [ 409.962680] nixbot[3635]: INFO: ::ffff:127.0.0.1:53270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 411.018029] nixbot[3635]: INFO: ::ffff:127.0.0.1:51670 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 412.072534] nixbot[3635]: INFO: ::ffff:127.0.0.1:51678 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 413.126299] nixbot[3635]: INFO: ::ffff:127.0.0.1:51690 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 414.182991] nixbot[3635]: INFO: ::ffff:127.0.0.1:51692 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 415.238607] nixbot[3635]: INFO: ::ffff:127.0.0.1:51708 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 416.294544] nixbot[3635]: INFO: ::ffff:127.0.0.1:51712 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 417.350796] nixbot[3635]: INFO: ::ffff:127.0.0.1:51720 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 418.406849] nixbot[3635]: INFO: ::ffff:127.0.0.1:51734 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 419.458941] nixbot[3635]: INFO: ::ffff:127.0.0.1:51740 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 420.512623] nixbot[3635]: INFO: ::ffff:127.0.0.1:51756 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab # [ 421.569188] nixbot[3635]: INFO: ::ffff:127.0.0.1:35224 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 422.622608] nixbot[3635]: INFO: ::ffff:127.0.0.1:35226 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 423.675605] nixbot[3635]: INFO: ::ffff:127.0.0.1:35232 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 424.726227] nixbot[3635]: INFO: ::ffff:127.0.0.1:35236 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 425.780899] nixbot[3635]: INFO: ::ffff:127.0.0.1:35246 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 426.835009] nixbot[3635]: INFO: ::ffff:127.0.0.1:35248 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab # [ 427.167941] postgres[4157]: [4157] ERROR: relation "table_without_models" does not exist gitlab # [ 427.171438] postgres[4157]: [4157] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab # [ 427.892844] nixbot[3635]: INFO: ::ffff:127.0.0.1:35260 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 428.947653] nixbot[3635]: INFO: ::ffff:127.0.0.1:35270 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 430.003858] nixbot[3635]: INFO: ::ffff:127.0.0.1:35278 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 431.058675] nixbot[3635]: INFO: ::ffff:127.0.0.1:36324 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab # [ 432.028562] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:02.693Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 432.032938] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:02.698Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 432.039688] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:02.698Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 432.045454] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:02.699Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 432.051582] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:02.700Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 432.116253] nixbot[3635]: INFO: ::ffff:127.0.0.1:36336 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab # [ 433.174225] nixbot[3635]: INFO: ::ffff:127.0.0.1:36352 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 434.227892] nixbot[3635]: INFO: ::ffff:127.0.0.1:36360 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab # [ 434.650220] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:05.314Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2f7d520b2a1df8d385ad7607","created_at":"2026-08-16T17:06:35.676Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:35.746Z","job_size_bytes":2,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2f7d520b2a1df8d385ad7607: start","job_status":"start","queue_duration_s":89.568674,"scheduling_latency_s":89.56877} gitlab # [ 435.047552] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:05.712Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"2f7d520b2a1df8d385ad7607","created_at":"2026-08-16T17:06:35.676Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:35.746Z","job_size_bytes":2,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-2f7d520b2a1df8d385ad7607: done: 0.39788 sec","job_status":"done","queue_duration_s":89.568674,"scheduling_latency_s":89.56877,"redis_calls":23,"redis_duration_s":0.011803000000000001,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.006497,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003174,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002132,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.205134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.21047876,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.39788,"completed_at":"2026-08-16T17:08:05.712Z","load_balancing_strategy":"primary","db_duration_s":0.11072,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 435.147361] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:05.715Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"08ccf3f9aa2bade07531a358","created_at":"2026-08-16T17:06:35.791Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:35.810Z","job_size_bytes":2,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-08ccf3f9aa2bade07531a358: start","job_status":"start","queue_duration_s":89.905136,"scheduling_latency_s":89.905178} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.07 seconds) gitlab # [ 435.239253] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:05.904Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"08ccf3f9aa2bade07531a358","created_at":"2026-08-16T17:06:35.791Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:35.810Z","job_size_bytes":2,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-08ccf3f9aa2bade07531a358: done: 0.189147 sec","job_status":"done","queue_duration_s":89.905136,"scheduling_latency_s":89.905178,"redis_calls":14,"redis_duration_s":0.005105999999999999,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001051,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002466,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001589,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.140395,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14379352,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.189147,"completed_at":"2026-08-16T17:08:05.904Z","load_balancing_strategy":"primary","db_duration_s":0.036946,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 435.353558] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:05.909Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"ff9f55f3a44f1d32f566c7dc","created_at":"2026-08-16T17:06:37.716Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:37.723Z","job_size_bytes":5,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-ff9f55f3a44f1d32f566c7dc: start","job_status":"start","queue_duration_s":88.185721,"scheduling_latency_s":88.185754} gitlab # [ 435.378450] nixbot[3635]: INFO: ::ffff:127.0.0.1:36374 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab # [ 435.545338] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.210Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"ff9f55f3a44f1d32f566c7dc","created_at":"2026-08-16T17:06:37.716Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:37.723Z","job_size_bytes":5,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-ff9f55f3a44f1d32f566c7dc: done: 0.301151 sec","job_status":"done","queue_duration_s":88.185721,"scheduling_latency_s":88.185754,"redis_calls":12,"redis_duration_s":0.007052,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.003131,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002917,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001004,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.027,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.240058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00046012,"duration_s":0.301151,"completed_at":"2026-08-16T17:08:06.210Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.046051,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 435.654162] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.212Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d061f3115f325e2bd644cee6","created_at":"2026-08-16T17:06:37.769Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:37.776Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d061f3115f325e2bd644cee6: start","job_status":"start","queue_duration_s":88.436605,"scheduling_latency_s":88.436628} gitlab # [ 435.847082] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.512Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"d061f3115f325e2bd644cee6","created_at":"2026-08-16T17:06:37.769Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:37.776Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-d061f3115f325e2bd644cee6: done: 0.299625 sec","job_status":"done","queue_duration_s":88.436605,"scheduling_latency_s":88.436628,"redis_calls":11,"redis_duration_s":0.003503,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00088,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001985,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.042,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.252,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.252,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.192182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063178,"duration_s":0.299625,"completed_at":"2026-08-16T17:08:06.512Z","load_balancing_strategy":"primary","db_duration_s":0.111223,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 435.945778] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.515Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"bcb77ad627410589c14ac2c1","created_at":"2026-08-16T17:06:37.780Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:37.786Z","job_size_bytes":89,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-bcb77ad627410589c14ac2c1: start","job_status":"start","queue_duration_s":88.728758,"scheduling_latency_s":88.72879} gitlab # [ 435.995242] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.567Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"bcb77ad627410589c14ac2c1","created_at":"2026-08-16T17:06:37.780Z","trace_propagation_headers":{"sentry-trace":"ede8475cee1d43418a1466e04b7c4a4e-a79e43eadbc84f47","baggage":"sentry-trace_id=ede8475cee1d43418a1466e04b7c4a4e,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RM44ZGEG0WV94ADF802CD","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:37.786Z","job_size_bytes":89,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-bcb77ad627410589c14ac2c1: done: 0.052963 sec","job_status":"done","queue_duration_s":88.728758,"scheduling_latency_s":88.72879,"redis_calls":11,"redis_duration_s":0.00357,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000918,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002012,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00064,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034121,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00069134,"duration_s":0.052963,"completed_at":"2026-08-16T17:08:06.567Z","load_balancing_strategy":"primary","db_duration_s":0.00912,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 436.070944] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.570Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5db0d0603fe204acefee48ac","created_at":"2026-08-16T17:06:40.483Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-e5c6c6538c1b4137","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:40.492Z","job_size_bytes":185,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5db0d0603fe204acefee48ac: start","job_status":"start","queue_duration_s":86.077733,"scheduling_latency_s":86.077758} gitlab # [ 436.094263] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:06.591Z","message":"changes: \"0000000000000000000000000000000000000000 3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 refs/heads/master\\n\""} gitlab # [ 436.098358] gitaly[923]: time="2026-08-16T17:08:06.642Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:16.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:06.627" grpc.time_ms=13.968 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.114681] gitaly[923]: time="2026-08-16T17:08:06.662Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:08:16.027" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:06.648" grpc.time_ms=14.142 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.129973] gitaly[923]: time="2026-08-16T17:08:06.733Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T17:08:16.099" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:06.719" grpc.time_ms=13.059 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.144088] gitaly[923]: time="2026-08-16T17:08:06.803Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:06.802" grpc.time_ms=0.749 pid=923 span.kind=server system=grpc gitlab # [ 436.181240] gitaly[923]: time="2026-08-16T17:08:06.847Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:06.846" grpc.time_ms=0.459 pid=923 span.kind=server system=grpc gitlab # [ 436.200683] gitaly[923]: time="2026-08-16T17:08:06.859Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF diskcache=ff3c8150-ae81-4a5f-809c-c3acdb8b5be9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:08:16.123" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:06.744" pid=923 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 436.217781] gitaly[923]: time="2026-08-16T17:08:06.859Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=123 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5192 command.oublock=8 command.real_time_ms=109 command.spawn_token_fork_ms=1 command.system_time_ms=71 command.user_time_ms=52 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:08:16.123" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:06.744" grpc.time_ms=115.53 pid=923 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 436.236106] gitaly[923]: time="2026-08-16T17:08:06.888Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-16T17:08:16.267" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:06.888" grpc.time_ms=0.278 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.253322] gitaly[923]: time="2026-08-16T17:08:06.919Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=858 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-16T17:08:16.275" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:06.896" grpc.time_ms=22.915 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 436.363320] nixbot[3635]: INFO: ::ffff:127.0.0.1:36382 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.07 seconds) gitlab # [ 436.426959] gitaly[923]: time="2026-08-16T17:08:07.092Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-16T17:08:37.079" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:07.079" grpc.time_ms=12.743 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.492576] gitaly[923]: time="2026-08-16T17:08:07.158Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:08:17.006" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:07.157" grpc.time_ms=0.579 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.523144] gitaly[923]: time="2026-08-16T17:08:07.175Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T17:08:17.012" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T17:08:07.162" grpc.time_ms=12.318 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.554530] gitaly[923]: time="2026-08-16T17:08:07.220Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:17.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:07.202" grpc.time_ms=17.924 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.583770] gitaly[923]: time="2026-08-16T17:08:07.249Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:17.080" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:07.231" grpc.time_ms=18.588 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.638052] gitaly[923]: time="2026-08-16T17:08:07.304Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:08:37.273" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:07.274" grpc.time_ms=29.731 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 437.228425] gitaly[923]: time="2026-08-16T17:08:07.893Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T17:08:17.270" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:07.890" grpc.time_ms=2.294 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 437.268283] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:07.932Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5db0d0603fe204acefee48ac","created_at":"2026-08-16T17:06:40.483Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-e5c6c6538c1b4137","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:40.492Z","job_size_bytes":185,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5db0d0603fe204acefee48ac: done: 1.362508 sec","job_status":"done","queue_duration_s":86.077733,"scheduling_latency_s":86.077758,"gitaly_calls":13,"gitaly_duration_s":0.329166,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.06320100000000001,"redis_read_bytes":2103,"redis_write_bytes":21751,"redis_cache_calls":15,"redis_cache_duration_s":0.006721,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.008247,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.00242,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7839,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005788,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.025093,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.014932,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.091,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.316,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.363,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.091,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.883037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00078666,"exclusive_lock_hold_duration_s":0.036721540000000004,"duration_s":1.362508,"completed_at":"2026-08-16T17:08:07.932Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.157587,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 437.371608] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:07.935Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"20c73874d3f015232e5b9502","created_at":"2026-08-16T17:06:45.492Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-46971428077f4598","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:45.495Z","job_size_bytes":185,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-20c73874d3f015232e5b9502: start","job_status":"start","queue_duration_s":82.440216,"scheduling_latency_s":82.440242} gitlab # [ 437.391576] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:07.948Z","message":"changes: \"3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 refs/heads/master\\n\""} gitlab # [ 437.394607] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.011Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"dbc348e0de90a1bc2cdbf0aa","created_at":"2026-08-16T17:08:08.008Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"aa2c62cb516b5227cd68ffe1","job_size_bytes":46,"pid":3532,"job_status":"deduplicated","message":"ProjectCacheWorker JID-dbc348e0de90a1bc2cdbf0aa: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 437.411823] gitaly[923]: time="2026-08-16T17:08:07.982Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:17.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:07.967" grpc.time_ms=14.691 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 437.428049] gitaly[923]: time="2026-08-16T17:08:08.003Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-16T17:08:17.026" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:07.986" grpc.time_ms=16.63 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.07 seconds) gitlab # [ 437.443609] gitaly[923]: time="2026-08-16T17:08:08.055Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-16T17:08:18.007" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:08.037" grpc.time_ms=17.319 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 437.458541] nixbot[3635]: INFO: ::ffff:127.0.0.1:36396 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab # [ 437.460596] gitaly[923]: time="2026-08-16T17:08:08.087Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-16T17:08:38.066" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:08.067" grpc.time_ms=19.92 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 437.476830] gitaly[923]: time="2026-08-16T17:08:08.117Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-16T17:08:18.074" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-16T17:08:08.105" grpc.time_ms=11.979 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 437.490058] gitaly[923]: time="2026-08-16T17:08:08.151Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:18.104" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:08.134" grpc.time_ms=16.565 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 437.658061] gitaly[923]: time="2026-08-16T17:08:08.324Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-16T17:08:18.171" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:08.321" grpc.time_ms=2.326 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 437.697627] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.362Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"20c73874d3f015232e5b9502","created_at":"2026-08-16T17:06:45.492Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-46971428077f4598","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-16T17:06:45.495Z","job_size_bytes":185,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-20c73874d3f015232e5b9502: done: 0.426929 sec","job_status":"done","queue_duration_s":82.440216,"scheduling_latency_s":82.440242,"gitaly_calls":7,"gitaly_duration_s":0.125587,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.0398,"redis_read_bytes":500,"redis_write_bytes":11943,"redis_cache_calls":9,"redis_cache_duration_s":0.004318,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.001945,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5720,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006229,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.013534,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.013774,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.044,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.044,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.04,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.253093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00072622,"exclusive_lock_hold_duration_s":0.02434694,"duration_s":0.426929,"completed_at":"2026-08-16T17:08:08.362Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041319,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 437.787463] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.366Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"73db8523c79b1926b98a1907","created_at":"2026-08-16T17:06:47.458Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-114f4c9a19fb4ec8","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:47.475Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-73db8523c79b1926b98a1907: start","job_status":"start","queue_duration_s":80.890919,"scheduling_latency_s":80.890969} gitlab # [ 437.897870] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.562Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"73db8523c79b1926b98a1907","created_at":"2026-08-16T17:06:47.458Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-114f4c9a19fb4ec8","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:47.475Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-73db8523c79b1926b98a1907: done: 0.196179 sec","job_status":"done","queue_duration_s":80.890919,"scheduling_latency_s":80.890969,"redis_calls":16,"redis_duration_s":0.007585,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003607,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000969,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.139779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00098338,"duration_s":0.196179,"completed_at":"2026-08-16T17:08:08.562Z","load_balancing_strategy":"primary","db_duration_s":0.040779,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 437.995531] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.566Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"48e7111def8345383d5ad27e","created_at":"2026-08-16T17:06:47.480Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-114f4c9a19fb4ec8","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:47.492Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-48e7111def8345383d5ad27e: start","job_status":"start","queue_duration_s":81.074408,"scheduling_latency_s":81.074457} gitlab # [ 438.234206] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.899Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"48e7111def8345383d5ad27e","created_at":"2026-08-16T17:06:47.480Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-114f4c9a19fb4ec8","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:47.492Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-48e7111def8345383d5ad27e: done: 0.333093 sec","job_status":"done","queue_duration_s":81.074408,"scheduling_latency_s":81.074457,"redis_calls":21,"redis_duration_s":0.008158,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.00406,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002096,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002002,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.046,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.034,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.263187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00053108,"duration_s":0.333093,"completed_at":"2026-08-16T17:08:08.899Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.055285,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 438.351523] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:08.902Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5880b6e2c0a625b6c6a73ec5","created_at":"2026-08-16T17:06:47.738Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-114f4c9a19fb4ec8","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:47.753Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5880b6e2c0a625b6c6a73ec5: start","job_status":"start","queue_duration_s":81.148782,"scheduling_latency_s":81.148809} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 438.492346] nixbot[3635]: INFO: ::ffff:127.0.0.1:36398 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.05 seconds) gitlab # [ 438.503786] gitaly[923]: time="2026-08-16T17:08:09.168Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:09.167" grpc.time_ms=0.781 pid=923 span.kind=server system=grpc gitlab # [ 438.581806] gitaly[923]: time="2026-08-16T17:08:09.247Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:09.246" grpc.time_ms=0.738 pid=923 span.kind=server system=grpc gitlab # [ 438.634140] gitaly[923]: time="2026-08-16T17:08:09.300Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:09.298" grpc.time_ms=1.119 pid=923 span.kind=server system=grpc gitlab # [ 438.663867] gitaly[923]: time="2026-08-16T17:08:09.312Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB diskcache=e8a372bf-11ab-4cd3-87ef-bb7912fee0dd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:39.104" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:09.105" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 438.686117] gitaly[923]: time="2026-08-16T17:08:09.312Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=211 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7523 command.oublock=0 command.real_time_ms=199 command.spawn_token_fork_ms=1 command.system_time_ms=132 command.user_time_ms=79 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:39.104" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:09.105" grpc.time_ms=206.611 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 438.868980] gitaly[923]: time="2026-08-16T17:08:09.534Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:08:39.532" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:09.533" grpc.time_ms=1.561 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 438.927875] gitaly[923]: time="2026-08-16T17:08:09.593Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMHTPMK938PQEX88HYGRB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:39.591" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:09.592" grpc.time_ms=1.108 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 438.972985] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:09.637Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"5880b6e2c0a625b6c6a73ec5","created_at":"2026-08-16T17:06:47.738Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-114f4c9a19fb4ec8","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:06:47.753Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-5880b6e2c0a625b6c6a73ec5: done: 0.735867 sec","job_status":"done","queue_duration_s":81.148782,"scheduling_latency_s":81.148809,"gitaly_calls":3,"gitaly_duration_s":0.222438,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.042215,"redis_read_bytes":457,"redis_write_bytes":27998,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001804,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001736,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.015479,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.006406,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14492,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.009515,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000868,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000955,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003648,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.098,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.033,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.04,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.05,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.382426,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.6390608000000001,"duration_s":0.735867,"completed_at":"2026-08-16T17:08:09.637Z","load_balancing_strategy":"primary","db_duration_s":0.116778,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 439.050156] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:09.641Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"aa2c62cb516b5227cd68ffe1","created_at":"2026-08-16T17:08:06.665Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:06.687Z","job_size_bytes":46,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-aa2c62cb516b5227cd68ffe1: start","job_status":"start","queue_duration_s":2.953528,"scheduling_latency_s":2.953567} gitlab # [ 439.072834] gitaly[923]: time="2026-08-16T17:08:09.738Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-16T23:08:09.727" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:09.727" grpc.time_ms=10.346 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 439.104601] gitaly[923]: time="2026-08-16T17:08:09.770Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T17:08:39.751" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:09.752" grpc.time_ms=18.314 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 439.154114] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:09.819Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"aa2c62cb516b5227cd68ffe1","created_at":"2026-08-16T17:08:06.665Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:06.687Z","job_size_bytes":46,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-aa2c62cb516b5227cd68ffe1: done: 0.178164 sec","job_status":"done","queue_duration_s":2.953528,"scheduling_latency_s":2.953567,"gitaly_calls":2,"gitaly_duration_s":0.035551,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.011894,"redis_read_bytes":69,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002424,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.001061,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2115,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002594,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004597,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":753,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001218,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.113295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00057854,"duration_s":0.178164,"completed_at":"2026-08-16T17:08:09.819Z","load_balancing_strategy":"primary","db_duration_s":0.019048,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 439.246084] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:09.821Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e853c79ea30d3f1edd7c1327","created_at":"2026-08-16T17:08:06.709Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:06.715Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e853c79ea30d3f1edd7c1327: start","job_status":"start","queue_duration_s":3.106542,"scheduling_latency_s":3.10657} gitlab # [ 439.268290] gitaly[923]: time="2026-08-16T17:08:09.902Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF diskcache=6f831560-e786-4904-a6c7-56bbc48742f2 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:08:09.858" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:09.859" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 439.281630] gitaly[923]: time="2026-08-16T17:08:09.903Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=41 command.spawn_token_fork_ms=8 command.system_time_ms=23 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:08:09.858" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:09.859" grpc.time_ms=43.659 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 439.321474] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:09.986Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"e853c79ea30d3f1edd7c1327","created_at":"2026-08-16T17:08:06.709Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:06.715Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-e853c79ea30d3f1edd7c1327: done: 0.164878 sec","job_status":"done","queue_duration_s":3.106542,"scheduling_latency_s":3.10657,"gitaly_calls":1,"gitaly_duration_s":0.047248,"redis_calls":15,"redis_duration_s":0.006376,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000687,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002536,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001101,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002052,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.021,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.042,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082198,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12061654,"duration_s":0.164878,"completed_at":"2026-08-16T17:08:09.986Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.025497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 439.386327] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:09.989Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"a27ec7fcc9bc58b0c9a45d6a","created_at":"2026-08-16T17:08:06.879Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:06.883Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a27ec7fcc9bc58b0c9a45d6a: start","job_status":"start","queue_duration_s":3.105979,"scheduling_latency_s":3.106023} gitlab # [ 439.404877] gitaly[923]: time="2026-08-16T17:08:10.068Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=595 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-16T17:08:40.048" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:10.049" grpc.time_ms=18.927 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 439.424678] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:10.089Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"a27ec7fcc9bc58b0c9a45d6a","created_at":"2026-08-16T17:08:06.879Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:06.883Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-a27ec7fcc9bc58b0c9a45d6a: done: 0.100139 sec","job_status":"done","queue_duration_s":3.105979,"scheduling_latency_s":3.106023,"gitaly_calls":1,"gitaly_duration_s":0.02272,"redis_calls":16,"redis_duration_s":0.007009,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000593,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001937,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.003307,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001172,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.100139,"completed_at":"2026-08-16T17:08:10.089Z","load_balancing_strategy":"primary","db_duration_s":0.005479,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 439.470372] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:10.093Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"82f7321790f9ef126b9d2dd4","created_at":"2026-08-16T17:08:07.697Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c9cffabc8e68faf856a5c13c0f260700d6bbb38732e2a3433687e9dfc416f9cb","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:07.705Z","job_size_bytes":467,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-82f7321790f9ef126b9d2dd4: start","job_status":"start","queue_duration_s":2.387908,"scheduling_latency_s":2.387947} gitlab # [ 439.487567] gitaly[923]: time="2026-08-16T17:08:10.143Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:40.141" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:10.142" grpc.time_ms=1.008 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 439.500556] gitaly[923]: time="2026-08-16T17:08:10.165Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:08:20.117" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:10.147" grpc.time_ms=17.262 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 439.550163] nixbot[3635]: INFO: ::ffff:127.0.0.1:36414 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab # [ 439.679087] gitaly[923]: time="2026-08-16T17:08:10.343Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:08:40.341" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:10.342" grpc.time_ms=1.357 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 439.716254] gitaly[923]: time="2026-08-16T17:08:10.353Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=37 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T17:08:40.348" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:10.348" grpc.time_ms=4.335 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 439.872328] gitaly[923]: time="2026-08-16T17:08:10.538Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:20.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:10.520" grpc.time_ms=17.478 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 440.608321] nixbot[3635]: INFO: ::ffff:127.0.0.1:36428 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab # [ 440.697283] gitaly[923]: time="2026-08-16T17:08:11.362Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=16 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:08:41.034" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:11.334" grpc.time_ms=27.124 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 440.739495] gitaly[923]: time="2026-08-16T17:08:11.391Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RMA9YKSWZEKT0TS5Z9HSF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T17:08:41.065" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:11.366" grpc.time_ms=25.178 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 440.792711] sidekiq-cluster[3532]: {"severity":"WARN","time":"2026-08-16T17:08:11.457Z","class":"CreatePipelineWorker","correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"3139bc27e7fce8d04c34183bfc6fdaf8b6833a53","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"3139bc27e7fce8d04c34183bfc6fdaf8b6833a53","ref":"refs/heads/master"},"retry":0} gitlab # [ 440.814573] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:11.475Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"82f7321790f9ef126b9d2dd4","created_at":"2026-08-16T17:08:07.697Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c9cffabc8e68faf856a5c13c0f260700d6bbb38732e2a3433687e9dfc416f9cb","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:07.705Z","job_size_bytes":467,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-82f7321790f9ef126b9d2dd4: done: 1.382467 sec","job_status":"done","queue_duration_s":2.387908,"scheduling_latency_s":2.387947,"gitaly_calls":7,"gitaly_duration_s":0.117225,"redis_calls":51,"redis_duration_s":0.019051000000000002,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001549,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.008181,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002493,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004388,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00244,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.168225,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00078576,"duration_s":1.382467,"completed_at":"2026-08-16T17:08:11.475Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.090277,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 440.902174] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:11.479Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"ff68ec8b-6954-4f34-83da-cbd08eeec907\"}"],"class":"WebHookWorker","jid":"e37059354608c0dad2f2c064","created_at":"2026-08-16T17:08:07.853Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2edd7f40c4b077f49c6b3520b91cf0622b68069aaedfbeed2f741b03a2c7a3ad","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:07.859Z","job_size_bytes":1751,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e37059354608c0dad2f2c064: start","job_status":"start","queue_duration_s":3.619783,"scheduling_latency_s":3.619828} gitlab # [ 441.069310] nixbot[3635]: INFO: ::ffff:127.0.0.1:58196 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 441.113149] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:11.777Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"ff68ec8b-6954-4f34-83da-cbd08eeec907\"}"],"class":"WebHookWorker","jid":"e37059354608c0dad2f2c064","created_at":"2026-08-16T17:08:07.853Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-a229722acf024c86","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2edd7f40c4b077f49c6b3520b91cf0622b68069aaedfbeed2f741b03a2c7a3ad","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:07.859Z","job_size_bytes":1751,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e37059354608c0dad2f2c064: done: 0.298347 sec","job_status":"done","queue_duration_s":3.619783,"scheduling_latency_s":3.619828,"redis_calls":19,"redis_duration_s":0.007536,"redis_read_bytes":32,"redis_write_bytes":5367,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001937,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000773,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00312,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001706,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.08840989999998783,"cpu_s":0.18219,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007793,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.298347,"completed_at":"2026-08-16T17:08:11.777Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 441.231632] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:11.781Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ba789d95a292fa3f4f9b1600","created_at":"2026-08-16T17:08:08.024Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"e853c79ea30d3f1edd7c1327","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:08.029Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ba789d95a292fa3f4f9b1600: start","job_status":"start","queue_duration_s":3.752578,"scheduling_latency_s":3.75263} gitlab # [ 441.258588] gitaly[923]: time="2026-08-16T17:08:11.894Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 diskcache=dbb2d18c-4852-4b51-98e3-c4730861b9fd grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:08:11.823" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:11.824" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.272150] gitaly[923]: time="2026-08-16T17:08:11.895Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=289 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-16T23:08:11.823" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:11.824" grpc.time_ms=70.444 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.287919] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:11.930Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ba789d95a292fa3f4f9b1600","created_at":"2026-08-16T17:08:08.024Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"e853c79ea30d3f1edd7c1327","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:08.029Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ba789d95a292fa3f4f9b1600: done: 0.14877 sec","job_status":"done","queue_duration_s":3.752578,"scheduling_latency_s":3.75263,"gitaly_calls":1,"gitaly_duration_s":0.075199,"redis_calls":12,"redis_duration_s":0.009184999999999999,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003352,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.003204,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002629,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052122,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.10553462,"duration_s":0.14877,"completed_at":"2026-08-16T17:08:11.930Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009507,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 441.334787] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:11.935Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"52acb1530fb0a8a95fdd80e1","created_at":"2026-08-16T17:08:08.256Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31bf8c8b10bf503ec4477477ccb7f662a46907d329ed24c78bdea10e274679d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:08.261Z","job_size_bytes":467,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-52acb1530fb0a8a95fdd80e1: start","job_status":"start","queue_duration_s":3.674111,"scheduling_latency_s":3.674159} gitlab # [ 441.352169] gitaly[923]: time="2026-08-16T17:08:11.982Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ4W80H6MX09KBTX03NNZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:11.964" grpc.time_ms=17.23 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 441.366124] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 197 gitlab # [ 441.368257] gitaly[923]: time="2026-08-16T17:08:11.994Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:41.692" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:11.992" grpc.time_ms=1.149 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.380585] gitaly[923]: time="2026-08-16T17:08:12.018Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:08:21.038" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:11.999" grpc.time_ms=17.806 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.426984] gitaly[923]: time="2026-08-16T17:08:12.092Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:08:42.090" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:12.091" grpc.time_ms=1.384 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.449287] gitaly[923]: time="2026-08-16T17:08:12.103Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=26 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=1 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-16T17:08:42.098" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:12.099" grpc.time_ms=3.965 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.493430] gitaly[923]: time="2026-08-16T17:08:12.159Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:22.116" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:12.147" grpc.time_ms=11.664 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.575341] gitaly[923]: time="2026-08-16T17:08:12.241Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ52H8QTTBDMJAB31XTEH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:12.222" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 441.587252] gitaly[923]: time="2026-08-16T17:08:12.241Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ52H8QTTBDMJAB31XTEH grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:12.222" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 441.601998] gitlab-workhorse[825]: time="2026-08-16T17:08:12Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 441.603811] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:12 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 257 gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 441.606849] gitaly[923]: time="2026-08-16T17:08:12.242Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ52H8QTTBDMJAB31XTEH grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:12.222" grpc.time_ms=19.943 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 441.639058] nixbot[3635]: {"ts": "2026-08-16T17:08:12.304Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.06 seconds) gitlab # [ 441.671350] nixbot[3635]: INFO: ::ffff:127.0.0.1:58202 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab # [ 441.813912] gitaly[923]: time="2026-08-16T17:08:12.478Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:42.476" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:12.477" grpc.time_ms=1.157 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.921919] gitaly[923]: time="2026-08-16T17:08:12.587Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:22.148" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:12.568" grpc.time_ms=18.966 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 442.004846] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 341 gitlab # [ 442.014131] nixbot[3635]: {"ts": "2026-08-16T17:08:12.672Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""} gitlab # [ 442.140187] gitaly[923]: time="2026-08-16T17:08:12.806Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ5R9P52NDBE3KB8N69H7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:42.603" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:12.804" grpc.time_ms=1.207 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 442.176426] gitaly[923]: time="2026-08-16T17:08:12.842Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=8 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-16T17:08:42.520" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:12.821" grpc.time_ms=20.545 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 442.206779] gitaly[923]: time="2026-08-16T17:08:12.858Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M05RMG0NSRS5JN7G076JGYE8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-16T17:08:42.545" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:12.845" grpc.time_ms=12.928 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 442.227099] sidekiq-cluster[3532]: {"severity":"WARN","time":"2026-08-16T17:08:12.879Z","class":"CreatePipelineWorker","correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"3139bc27e7fce8d04c34183bfc6fdaf8b6833a53","after":"4d08eaf3d0520ce6ede23381e4a7abb44d0744a1","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"4d08eaf3d0520ce6ede23381e4a7abb44d0744a1","ref":"refs/heads/master"},"retry":0} gitlab # [ 442.237047] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:12.892Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"52acb1530fb0a8a95fdd80e1","created_at":"2026-08-16T17:08:08.256Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:31bf8c8b10bf503ec4477477ccb7f662a46907d329ed24c78bdea10e274679d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:08.261Z","job_size_bytes":467,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-52acb1530fb0a8a95fdd80e1: done: 0.956933 sec","job_status":"done","queue_duration_s":3.674111,"scheduling_latency_s":3.674159,"gitaly_calls":7,"gitaly_duration_s":0.100427,"redis_calls":33,"redis_duration_s":0.008609,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.001137,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002163,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003949,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00136,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.038,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.824683,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.956933,"completed_at":"2026-08-16T17:08:12.892Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037386,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 442.294648] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:12.896Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"ed6ba2f1-194a-4bfe-87c2-229182a0085c\"}"],"class":"WebHookWorker","jid":"5a1073bb8093975dc8ea1700","created_at":"2026-08-16T17:08:08.291Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2bb92d81500effe3a5955f6968e9d1177698fbf802b941fb9baa2da63e0761a5","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:08.296Z","job_size_bytes":1749,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-5a1073bb8093975dc8ea1700: start","job_status":"start","queue_duration_s":4.599838,"scheduling_latency_s":4.59989} gitlab # [ 442.313816] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:12.968Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"ed6ba2f1-194a-4bfe-87c2-229182a0085c\"}"],"class":"WebHookWorker","jid":"5a1073bb8093975dc8ea1700","created_at":"2026-08-16T17:08:08.291Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-d689edc6a35e40be","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2bb92d81500effe3a5955f6968e9d1177698fbf802b941fb9baa2da63e0761a5","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:08.296Z","job_size_bytes":1749,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-5a1073bb8093975dc8ea1700: done: 0.072031 sec","job_status":"done","queue_duration_s":4.599838,"scheduling_latency_s":4.59989,"redis_calls":14,"redis_duration_s":0.008709999999999999,"redis_read_bytes":26,"redis_write_bytes":4685,"redis_queues_calls":2,"redis_queues_duration_s":0.001429,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3729,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004042,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003239,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.008418440000014016,"cpu_s":0.044406,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.072031,"completed_at":"2026-08-16T17:08:12.968Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003788,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.360608] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:12.971Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fcf9b96e465de94ed927d60f","created_at":"2026-08-16T17:08:09.076Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.083Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fcf9b96e465de94ed927d60f: start","job_status":"start","queue_duration_s":3.888255,"scheduling_latency_s":3.888311} gitlab # [ 442.376770] nixbot[3635]: INFO: ::ffff:127.0.0.1:58214 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 442.378001] gitaly[923]: time="2026-08-16T17:08:12.984Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=6 command.system_time_ms=4 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ5R9P52NDBE3KB8N69H7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:22.043" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:12.964" grpc.time_ms=19.847 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 442.449735] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.112Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"fcf9b96e465de94ed927d60f","created_at":"2026-08-16T17:08:09.076Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.083Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-fcf9b96e465de94ed927d60f: done: 0.141252 sec","job_status":"done","queue_duration_s":3.888255,"scheduling_latency_s":3.888311,"redis_calls":10,"redis_duration_s":0.006906000000000001,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00111,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003954,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001842,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.099208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00085888,"duration_s":0.141252,"completed_at":"2026-08-16T17:08:13.112Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027228,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 442.519345] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.117Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"9fc05a929bc9bacf59c363bb","created_at":"2026-08-16T17:08:09.323Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.332Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-9fc05a929bc9bacf59c363bb: start","job_status":"start","queue_duration_s":3.784589,"scheduling_latency_s":3.784621} gitlab # [ 442.537420] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.163Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"9fc05a929bc9bacf59c363bb","created_at":"2026-08-16T17:08:09.323Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.332Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-9fc05a929bc9bacf59c363bb: done: 0.04697 sec","job_status":"done","queue_duration_s":3.784589,"scheduling_latency_s":3.784621,"redis_calls":10,"redis_duration_s":0.003589,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000392,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001602,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001595,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000464,"duration_s":0.04697,"completed_at":"2026-08-16T17:08:13.163Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.582021] nixbot[3635]: {"ts": "2026-08-16T17:08:13.135Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""} gitlab # [ 442.585264] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 449 gitlab # [ 442.587740] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 229 gitlab # [ 442.590054] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.169Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ff2c7b031e86e401c9dd2a8f","created_at":"2026-08-16T17:08:09.357Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.369Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ff2c7b031e86e401c9dd2a8f: start","job_status":"start","queue_duration_s":3.800044,"scheduling_latency_s":3.800066} gitlab # [ 442.606170] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.210Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"ff2c7b031e86e401c9dd2a8f","created_at":"2026-08-16T17:08:09.357Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.369Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-ff2c7b031e86e401c9dd2a8f: done: 0.041206 sec","job_status":"done","queue_duration_s":3.800044,"scheduling_latency_s":3.800066,"redis_calls":10,"redis_duration_s":0.001567,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000352,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000866,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000349,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025596,"duration_s":0.041206,"completed_at":"2026-08-16T17:08:13.210Z","load_balancing_strategy":"primary","db_duration_s":0.005994,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.651102] gitaly[923]: time="2026-08-16T17:08:13.208Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ61K1PPQTAYNMF297SZ2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=196 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.187" grpc.time_ms=20.926 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 442.664526] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.212Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7e8242966fabbeda96d3a9d3","created_at":"2026-08-16T17:08:09.403Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.415Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7e8242966fabbeda96d3a9d3: start","job_status":"start","queue_duration_s":3.796364,"scheduling_latency_s":3.796381} gitlab # [ 442.679455] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.254Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"7e8242966fabbeda96d3a9d3","created_at":"2026-08-16T17:08:09.403Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.415Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-7e8242966fabbeda96d3a9d3: done: 0.042289 sec","job_status":"done","queue_duration_s":3.796364,"scheduling_latency_s":3.796381,"redis_calls":13,"redis_duration_s":0.001846,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00043,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000801,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000325,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023474,"duration_s":0.042289,"completed_at":"2026-08-16T17:08:13.254Z","load_balancing_strategy":"primary","db_duration_s":0.007385,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.723980] gitaly[923]: time="2026-08-16T17:08:13.243Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ66YRBEKX0Q0KDGVQC9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:43.042" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:13.243" grpc.time_ms=0.616 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 442.736645] nixbot[3635]: {"ts": "2026-08-16T17:08:13.368Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 \"HTTP/1.1 201 Created\""} gitlab # [ 442.744208] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.255Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3846adde843b6561ef2ea312","created_at":"2026-08-16T17:08:09.417Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.428Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3846adde843b6561ef2ea312: start","job_status":"start","queue_duration_s":3.82724,"scheduling_latency_s":3.827257} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.13 seconds) gitlab # [ 442.764352] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.295Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"3846adde843b6561ef2ea312","created_at":"2026-08-16T17:08:09.417Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.428Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-3846adde843b6561ef2ea312: done: 0.039826 sec","job_status":"done","queue_duration_s":3.82724,"scheduling_latency_s":3.827257,"redis_calls":10,"redis_duration_s":0.0023350000000000003,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000294,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001164,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002253,"duration_s":0.039826,"completed_at":"2026-08-16T17:08:13.295Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007631,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.811535] gitlab-workhorse[825]: time="2026-08-16T17:08:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 442.813578] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 142 gitlab # [ 442.815489] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/3139bc27e7fce8d04c34183bfc6fdaf8b6833a53 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 215 gitlab # [ 442.818505] gitaly[923]: time="2026-08-16T17:08:13.303Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ66YRBEKX0Q0KDGVQC9J grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:23.288" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:13.288" grpc.time_ms=14.856 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 442.832660] nix-daemon[3858]: accepted connection from pid 4411, user nixbot gitlab # [ 442.833651] nixbot[3635]: INFO: ::ffff:127.0.0.1:58218 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab # [ 442.835613] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.297Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"302c77b25996c0c79a7c8d4e","created_at":"2026-08-16T17:08:09.429Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.440Z","job_size_bytes":19,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-302c77b25996c0c79a7c8d4e: start","job_status":"start","queue_duration_s":3.856465,"scheduling_latency_s":3.856485} gitlab # [ 442.853210] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.337Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"302c77b25996c0c79a7c8d4e","created_at":"2026-08-16T17:08:09.429Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.440Z","job_size_bytes":19,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-302c77b25996c0c79a7c8d4e: done: 0.040442 sec","job_status":"done","queue_duration_s":3.856465,"scheduling_latency_s":3.856485,"redis_calls":11,"redis_duration_s":0.0066879999999999995,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000455,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.005377,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000856,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003706,"duration_s":0.040442,"completed_at":"2026-08-16T17:08:13.337Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006345,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.897334] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 75 gitlab # [ 442.899345] gitlab-workhorse[825]: time="2026-08-16T17:08:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 442.901264] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 66 gitlab # [ 442.903131] gitaly[923]: time="2026-08-16T17:08:13.353Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ68W49YCPMJESK7W9NZZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.334" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 442.913483] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.339Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c3633526ab7f6d427a27a3e0","created_at":"2026-08-16T17:08:09.449Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.457Z","job_size_bytes":66,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c3633526ab7f6d427a27a3e0: start","job_status":"start","queue_duration_s":3.881551,"scheduling_latency_s":3.881568} gitlab # [ 442.930675] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.379Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"c3633526ab7f6d427a27a3e0","created_at":"2026-08-16T17:08:09.449Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.457Z","job_size_bytes":66,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-c3633526ab7f6d427a27a3e0: done: 0.040232 sec","job_status":"done","queue_duration_s":3.881551,"scheduling_latency_s":3.881568,"redis_calls":10,"redis_duration_s":0.003202,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001999,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000734,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004566,"duration_s":0.040232,"completed_at":"2026-08-16T17:08:13.379Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008969,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.975633] gitaly[923]: time="2026-08-16T17:08:13.353Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ68W49YCPMJESK7W9NZZ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.334" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 442.989530] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.384Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f6e7ec64afc7c1384f2ba926","created_at":"2026-08-16T17:08:09.459Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.467Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f6e7ec64afc7c1384f2ba926: start","job_status":"start","queue_duration_s":3.916204,"scheduling_latency_s":3.916229} gitlab # [ 443.005715] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.440Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"f6e7ec64afc7c1384f2ba926","created_at":"2026-08-16T17:08:09.459Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.467Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-f6e7ec64afc7c1384f2ba926: done: 0.056821 sec","job_status":"done","queue_duration_s":3.916204,"scheduling_latency_s":3.916229,"redis_calls":10,"redis_duration_s":0.004273,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000391,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003108,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000774,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00172938,"duration_s":0.056821,"completed_at":"2026-08-16T17:08:13.440Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0058,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.050964] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 60 gitlab # [ 443.053024] gitaly[923]: time="2026-08-16T17:08:13.354Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ68W49YCPMJESK7W9NZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.334" grpc.time_ms=19.305 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 443.067465] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.442Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c9e9cd0ff30ddd84089fa5f3","created_at":"2026-08-16T17:08:09.481Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.487Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c9e9cd0ff30ddd84089fa5f3: start","job_status":"start","queue_duration_s":3.954937,"scheduling_latency_s":3.954956} gitlab # [ 443.084920] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.486Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c9e9cd0ff30ddd84089fa5f3","created_at":"2026-08-16T17:08:09.481Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.487Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c9e9cd0ff30ddd84089fa5f3: done: 0.043713 sec","job_status":"done","queue_duration_s":3.954937,"scheduling_latency_s":3.954956,"redis_calls":10,"redis_duration_s":0.001992,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001022,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000519,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024505,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00029514,"duration_s":0.043713,"completed_at":"2026-08-16T17:08:13.486Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009851,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.129286] gitaly[923]: time="2026-08-16T17:08:13.481Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=8 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6EY7BFSVPY0Z3R896RJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=194 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.464" grpc.time_ms=17.22 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 443.142068] gitaly[923]: time="2026-08-16T17:08:13.549Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6HBQWMA47T2PFHTBTZ6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.541" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 443.152752] gitlab-workhorse[825]: time="2026-08-16T17:08:13Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 443.154678] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:13 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 86 gitlab # [ 443.156649] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.492Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"05e71ac60aa9c8dc74210fef","created_at":"2026-08-16T17:08:09.488Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.494Z","job_size_bytes":6,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-05e71ac60aa9c8dc74210fef: start","job_status":"start","queue_duration_s":3.997731,"scheduling_latency_s":3.997755} gitlab # [ 443.172970] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.525Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"05e71ac60aa9c8dc74210fef","created_at":"2026-08-16T17:08:09.488Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.494Z","job_size_bytes":6,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-05e71ac60aa9c8dc74210fef: done: 0.032745 sec","job_status":"done","queue_duration_s":3.997731,"scheduling_latency_s":3.997755,"redis_calls":10,"redis_duration_s":0.00897,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002763,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00231354,"duration_s":0.032745,"completed_at":"2026-08-16T17:08:13.525Z","load_balancing_strategy":"primary","db_duration_s":0.001852,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.217176] gitaly[923]: time="2026-08-16T17:08:13.549Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6HBQWMA47T2PFHTBTZ6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.541" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 443.231492] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.527Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0dbacd7b09c9c884fa2441e1","created_at":"2026-08-16T17:08:09.495Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.502Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0dbacd7b09c9c884fa2441e1: start","job_status":"start","queue_duration_s":4.025105,"scheduling_latency_s":4.025128} gitlab # [ 443.248339] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.572Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"0dbacd7b09c9c884fa2441e1","created_at":"2026-08-16T17:08:09.495Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.502Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-0dbacd7b09c9c884fa2441e1: done: 0.04541 sec","job_status":"done","queue_duration_s":4.025105,"scheduling_latency_s":4.025128,"redis_calls":10,"redis_duration_s":0.0017720000000000001,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000327,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001056,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000389,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003623,"duration_s":0.04541,"completed_at":"2026-08-16T17:08:13.572Z","load_balancing_strategy":"primary","db_duration_s":0.009527,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.291471] gitaly[923]: time="2026-08-16T17:08:13.550Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6HBQWMA47T2PFHTBTZ6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.541" grpc.time_ms=8.165 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 443.306237] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.574Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"06b20e07e1d94bb39291730a","created_at":"2026-08-16T17:08:09.510Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.517Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-06b20e07e1d94bb39291730a: start","job_status":"start","queue_duration_s":4.056847,"scheduling_latency_s":4.056867} gitlab # [ 443.323066] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.652Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"06b20e07e1d94bb39291730a","created_at":"2026-08-16T17:08:09.510Z","trace_propagation_headers":{"sentry-trace":"84ec27664ff14222bf1cff53c4e12156-0f0aee21d5d54e10","baggage":"sentry-trace_id=84ec27664ff14222bf1cff53c4e12156,sentry-release=Unknown"},"correlation_id":"01M05RMHTPMK938PQEX88HYGRB","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.517Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-06b20e07e1d94bb39291730a: done: 0.078606 sec","job_status":"done","queue_duration_s":4.056847,"scheduling_latency_s":4.056867,"redis_calls":14,"redis_duration_s":0.004879,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003639,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000976,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0022352,"duration_s":0.078606,"completed_at":"2026-08-16T17:08:13.652Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01611,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.368526] gitaly[923]: time="2026-08-16T17:08:13.644Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6MGJDYTESND1HQF77P4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.636" grpc.time_ms=7.403 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 443.382145] gitaly[923]: time="2026-08-16T17:08:13.732Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6PG8D7GDC3N0B9BBN1B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.708" pid=923 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 443.392865] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.655Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"071180749bab81b53228fedb","created_at":"2026-08-16T17:08:09.787Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-2938f90723dc4831","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.796Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-071180749bab81b53228fedb: start","job_status":"start","queue_duration_s":3.859238,"scheduling_latency_s":3.859264} gitlab # [ 443.408740] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.720Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"071180749bab81b53228fedb","created_at":"2026-08-16T17:08:09.787Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-2938f90723dc4831","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:09.796Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-071180749bab81b53228fedb: done: 0.064518 sec","job_status":"done","queue_duration_s":3.859238,"scheduling_latency_s":3.859264,"redis_calls":19,"redis_duration_s":0.008888,"redis_read_bytes":21,"redis_write_bytes":4292,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003629,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000844,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2263,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002996,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001419,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01004002,"duration_s":0.064518,"completed_at":"2026-08-16T17:08:13.720Z","load_balancing_strategy":"primary","db_duration_s":0.011555,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.454567] gitaly[923]: time="2026-08-16T17:08:13.733Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6PG8D7GDC3N0B9BBN1B grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.708" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 443.468064] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.721Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e37059354608c0dad2f2c064"],"class":"WebHooks::LogExecutionWorker","jid":"d1cb3286e0c0b79b24731f13","created_at":"2026-08-16T17:08:11.741Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-52a209f7996c40f5","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ce7a66dc3ed48916adbc104cb372ad2bb8bbc2ff161a2e36a7a63034a37431ca","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:11.755Z","job_size_bytes":2593,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d1cb3286e0c0b79b24731f13: start","job_status":"start","queue_duration_s":1.966365,"scheduling_latency_s":1.966384} gitlab # [ 443.485205] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.781Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e37059354608c0dad2f2c064"],"class":"WebHooks::LogExecutionWorker","jid":"d1cb3286e0c0b79b24731f13","created_at":"2026-08-16T17:08:11.741Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-52a209f7996c40f5","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ce7a66dc3ed48916adbc104cb372ad2bb8bbc2ff161a2e36a7a63034a37431ca","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:11.755Z","job_size_bytes":2593,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-d1cb3286e0c0b79b24731f13: done: 0.060205 sec","job_status":"done","queue_duration_s":1.966365,"scheduling_latency_s":1.966384,"redis_calls":10,"redis_duration_s":0.002126,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00088,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000364,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040866,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025626,"duration_s":0.060205,"completed_at":"2026-08-16T17:08:13.781Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013636,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.529888] gitaly[923]: time="2026-08-16T17:08:13.733Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=0 command.system_time_ms=17 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6PG8D7GDC3N0B9BBN1B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:13.708" grpc.time_ms=24.558 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 443.544984] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:14 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 386 gitlab # [ 443.547690] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:13.785Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"90aca753a214e829f7ed1e94","created_at":"2026-08-16T17:08:12.639Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-012a1087f8c4486d","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:12.647Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-90aca753a214e829f7ed1e94: start","job_status":"start","queue_duration_s":1.13857,"scheduling_latency_s":1.138589} gitlab # [ 443.563679] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.127Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"90aca753a214e829f7ed1e94","created_at":"2026-08-16T17:08:12.639Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-012a1087f8c4486d","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:12.647Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3532,"job_status":"rescheduled","message":"PipelineProcessWorker JID-90aca753a214e829f7ed1e94: rescheduled"} gitlab # [ 443.578494] nixbot[3635]: {"ts": "2026-08-16T17:08:14.168Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 \"HTTP/1.1 201 Created\""} gitlab # [ 443.581277] nixbot[3635]: {"ts": "2026-08-16T17:08:14.179Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-4d08eaf3d052-4"} gitlab # [ 443.583510] gitaly[923]: time="2026-08-16T17:08:13.852Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:43.850" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:13.851" grpc.time_ms=0.917 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.596348] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.134Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"90aca753a214e829f7ed1e94","created_at":"2026-08-16T17:08:12.639Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-012a1087f8c4486d","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:12.647Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-90aca753a214e829f7ed1e94: done: 0.349146 sec","job_status":"done","queue_duration_s":1.13857,"scheduling_latency_s":1.138589,"gitaly_calls":3,"gitaly_duration_s":0.151916,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.014951,"redis_read_bytes":148,"redis_write_bytes":18012,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.001384,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.000809,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.003141,"redis_queues_read_bytes":26,"redis_queues_write_bytes":12311,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.005204,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000241,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000342,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002446,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.009,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.009,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.021,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.141851,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.30075178,"duration_s":0.349146,"completed_at":"2026-08-16T17:08:14.134Z","load_balancing_strategy":"primary","db_duration_s":0.047191,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 443.647337] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.136Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","5a1073bb8093975dc8ea1700"],"class":"WebHooks::LogExecutionWorker","jid":"1dfd5d9e504491b338137f3d","created_at":"2026-08-16T17:08:12.949Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-1da00cd0d0f24ac9","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:24e3310ee378f8e39476b17cb9b23b083d7fa8777eabdf29919a23c77a17fd2d","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:12.954Z","job_size_bytes":2592,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1dfd5d9e504491b338137f3d: start","job_status":"start","queue_duration_s":1.182003,"scheduling_latency_s":1.182025} gitlab # [ 443.665502] nix-daemon[3858]: accepted connection from pid 4496, user nixbot gitlab # [ 443.666406] nix-daemon[3858]: accepted connection from pid 4504, user nixbot gitlab # [ 443.667295] gitaly[923]: time="2026-08-16T17:08:13.876Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-16T17:08:43.864" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:13.865" grpc.time_ms=10.82 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.681146] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.168Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","5a1073bb8093975dc8ea1700"],"class":"WebHooks::LogExecutionWorker","jid":"1dfd5d9e504491b338137f3d","created_at":"2026-08-16T17:08:12.949Z","trace_propagation_headers":{"sentry-trace":"cf80ac8fe018495f99f53478a2596cb3-1da00cd0d0f24ac9","baggage":"sentry-trace_id=cf80ac8fe018495f99f53478a2596cb3,sentry-release=Unknown"},"correlation_id":"01M05RMG0NSRS5JN7G076JGYE8","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:24e3310ee378f8e39476b17cb9b23b083d7fa8777eabdf29919a23c77a17fd2d","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:12.954Z","job_size_bytes":2592,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-1dfd5d9e504491b338137f3d: done: 0.032352 sec","job_status":"done","queue_duration_s":1.182003,"scheduling_latency_s":1.182025,"redis_calls":7,"redis_duration_s":0.0024660000000000003,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001971,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000495,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020158,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032352,"completed_at":"2026-08-16T17:08:14.168Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.723819] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.171Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"1ef3e0f140efb945bcb18f7f","created_at":"2026-08-16T17:08:13.702Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-e011c0682d974b53","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:13.709Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-1ef3e0f140efb945bcb18f7f: start","job_status":"start","queue_duration_s":0.461573,"scheduling_latency_s":0.461594} gitlab # [ 443.741457] nixbot[3635]: {"ts": "2026-08-16T17:08:14.339Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-4d08eaf3d052-4", "argv0": "bwrap"} gitlab # [ 443.743770] gitaly[923]: time="2026-08-16T17:08:13.898Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:23.164" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:13.885" grpc.time_ms=12.53 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.756971] gitaly[923]: time="2026-08-16T17:08:13.925Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:13.925" grpc.time_ms=0.391 pid=923 span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1' gitlab # [ 443.766486] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.285Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"1ef3e0f140efb945bcb18f7f","created_at":"2026-08-16T17:08:13.702Z","trace_propagation_headers":{"sentry-trace":"e4a4ed6dce5a401b86f7038d15d31640-e011c0682d974b53","baggage":"sentry-trace_id=e4a4ed6dce5a401b86f7038d15d31640,sentry-release=Unknown"},"correlation_id":"01M05RMA9YKSWZEKT0TS5Z9HSF","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:13.709Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-1ef3e0f140efb945bcb18f7f: done: 0.114083 sec","job_status":"done","queue_duration_s":0.461573,"scheduling_latency_s":0.461594,"redis_calls":11,"redis_duration_s":0.0033410000000000002,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000539,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002311,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004607,"duration_s":0.114083,"completed_at":"2026-08-16T17:08:14.285Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037165,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.810926] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.287Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"58d7ff92d6430ebb610cbda2","created_at":"2026-08-16T17:08:13.866Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:13.869Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-58d7ff92d6430ebb610cbda2: start","job_status":"start","queue_duration_s":0.418042,"scheduling_latency_s":0.418065} gitlab # [ 443.826411] gitaly[923]: time="2026-08-16T17:08:13.941Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-16T17:08:23.220" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:13.940" grpc.time_ms=0.269 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.836405] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.338Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"58d7ff92d6430ebb610cbda2","created_at":"2026-08-16T17:08:13.866Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:13.869Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-58d7ff92d6430ebb610cbda2: done: 0.051871 sec","job_status":"done","queue_duration_s":0.418042,"scheduling_latency_s":0.418065,"redis_calls":7,"redis_duration_s":0.00232,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001514,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000806,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.051871,"completed_at":"2026-08-16T17:08:14.338Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01365,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 443.878139] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.340Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2c65aca83775d565536df3fb","created_at":"2026-08-16T17:08:14.026Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.029Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2c65aca83775d565536df3fb: start","job_status":"start","queue_duration_s":0.311263,"scheduling_latency_s":0.311287} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', in 0.09 seconds) (finished: subtest: push delivers the webhook, in 89.93 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses gitlab # [ 443.894610] gitaly[923]: time="2026-08-16T17:08:13.963Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=568 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=8 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-16T17:08:23.229" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:13.949" grpc.time_ms=13.373 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.907837] gitaly[923]: time="2026-08-16T17:08:13.968Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:13.967" grpc.time_ms=0.414 pid=923 span.kind=server system=grpc gitlab # [ 443.917593] nixbot[3635]: INFO: ::ffff:127.0.0.1:58220 - "GET /api/repos/gitlab/root/test-flake/builds?commit=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 200 OK gitlab # [ 443.919864] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.378Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"2c65aca83775d565536df3fb","created_at":"2026-08-16T17:08:14.026Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.029Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-2c65aca83775d565536df3fb: done: 0.038045 sec","job_status":"done","queue_duration_s":0.311263,"scheduling_latency_s":0.311287,"redis_calls":7,"redis_duration_s":0.005018,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001285,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003733,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020472,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038045,"completed_at":"2026-08-16T17:08:14.378Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009096,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.963942] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.381Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cad7b7e67a7ff9baf3da4a76","created_at":"2026-08-16T17:08:14.037Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.043Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cad7b7e67a7ff9baf3da4a76: start","job_status":"start","queue_duration_s":0.337956,"scheduling_latency_s":0.337982} gitlab # [ 443.981087] nix-daemon[3858]: accepted connection from pid 4514, user nixbot gitlab # [ 443.982096] nix-daemon[3858]: accepted connection from pid 4526, user nixbot gitlab # [ 443.983080] gitaly[923]: time="2026-08-16T17:08:14.007Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:14.002" grpc.time_ms=4.999 pid=923 span.kind=server system=grpc gitlab # [ 443.993081] gitaly[923]: time="2026-08-16T17:08:14.013Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:14.007" grpc.time_ms=2.874 pid=923 span.kind=server system=grpc gitlab # [ 444.002841] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.422Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"cad7b7e67a7ff9baf3da4a76","created_at":"2026-08-16T17:08:14.037Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.043Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-cad7b7e67a7ff9baf3da4a76: done: 0.041056 sec","job_status":"done","queue_duration_s":0.337956,"scheduling_latency_s":0.337982,"redis_calls":7,"redis_duration_s":0.001857,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001382,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.01,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041056,"completed_at":"2026-08-16T17:08:14.422Z","load_balancing_strategy":"primary","db_duration_s":0.009513,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses, in 0.16 seconds) gitlab # [ 444.045175] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.424Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8344dc7c4f57550b247511bf","created_at":"2026-08-16T17:08:14.051Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.054Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8344dc7c4f57550b247511bf: start","job_status":"start","queue_duration_s":0.369966,"scheduling_latency_s":0.369989} gitlab # [ 444.062463] gitaly[923]: time="2026-08-16T17:08:14.019Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF diskcache=39b028f3-361f-4978-b9b6-684225805f29 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:43.575" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:13.876" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 444.072590] gitaly[923]: time="2026-08-16T17:08:14.020Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=132 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7292 command.oublock=0 command.real_time_ms=133 command.spawn_token_fork_ms=0 command.system_time_ms=68 command.user_time_ms=64 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:43.575" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:13.876" grpc.time_ms=143.749 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 444.086519] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.469Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"8344dc7c4f57550b247511bf","created_at":"2026-08-16T17:08:14.051Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.054Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-8344dc7c4f57550b247511bf: done: 0.044709 sec","job_status":"done","queue_duration_s":0.369966,"scheduling_latency_s":0.369989,"redis_calls":10,"redis_duration_s":0.002799,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001339,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000937,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000523,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028125,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044709,"completed_at":"2026-08-16T17:08:14.469Z","load_balancing_strategy":"primary","db_duration_s":0.011119,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 444.131018] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.470Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6c214ff90cb88c03761a174a","created_at":"2026-08-16T17:08:14.055Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.058Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6c214ff90cb88c03761a174a: start","job_status":"start","queue_duration_s":0.41247,"scheduling_latency_s":0.41249} gitlab # [ 444.148096] nix-daemon[3858]: accepted connection from pid 4540, user nixbot gitlab # [ 444.149011] nix-daemon[3858]: accepted connection from pid 4514, user nixbot gitlab # [ 444.150360] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:14 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 122 gitlab # [ 444.153007] gitaly[923]: time="2026-08-16T17:08:14.043Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:14.043" grpc.time_ms=0.402 pid=923 span.kind=server system=grpc gitlab # [ 444.162596] gitaly[923]: time="2026-08-16T17:08:14.054Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 diskcache=ef430ca3-89e8-41c6-a3f9-fc7d4af8ef7c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:08:23.246" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:13.967" pid=923 ref=refs/keep-around/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 remote_ip="2001:db8:1::1" revision=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 span.kind=server system=grpc username=root gitlab # [ 444.174380] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.519Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"6c214ff90cb88c03761a174a","created_at":"2026-08-16T17:08:14.055Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.058Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-6c214ff90cb88c03761a174a: done: 0.048439 sec","job_status":"done","queue_duration_s":0.41247,"scheduling_latency_s":0.41249,"redis_calls":7,"redis_duration_s":0.002651,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001802,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000849,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037459,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048439,"completed_at":"2026-08-16T17:08:14.519Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00526,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 444.218503] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.522Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"065a4d2d068d4b6996cfc4a4","created_at":"2026-08-16T17:08:14.059Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.061Z","job_size_bytes":19,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-065a4d2d068d4b6996cfc4a4: start","job_status":"start","queue_duration_s":0.460983,"scheduling_latency_s":0.461029} gitlab # [ 444.267293] gitaly[923]: time="2026-08-16T17:08:14.054Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=74 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5248 command.oublock=8 command.real_time_ms=80 command.spawn_token_fork_ms=2 command.system_time_ms=44 command.user_time_ms=30 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-16T17:08:23.246" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-16T17:08:13.967" grpc.time_ms=87.092 pid=923 ref=refs/keep-around/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 remote_ip="2001:db8:1::1" revision=4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 span.kind=server system=grpc username=root gitlab # [ 444.303608] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.575Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"065a4d2d068d4b6996cfc4a4","created_at":"2026-08-16T17:08:14.059Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.061Z","job_size_bytes":19,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-065a4d2d068d4b6996cfc4a4: done: 0.053311 sec","job_status":"done","queue_duration_s":0.460983,"scheduling_latency_s":0.461029,"redis_calls":8,"redis_duration_s":0.00266,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002102,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000558,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053311,"completed_at":"2026-08-16T17:08:14.575Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00528,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 444.361396] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.577Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"991d881b5e195fec67bfc756","created_at":"2026-08-16T17:08:14.062Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.064Z","job_size_bytes":66,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-991d881b5e195fec67bfc756: start","job_status":"start","queue_duration_s":0.513274,"scheduling_latency_s":0.513302} gitlab # [ 444.379564] gitaly[923]: time="2026-08-16T17:08:14.058Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:44.057" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:14.058" grpc.time_ms=0.495 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 444.392494] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.616Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"991d881b5e195fec67bfc756","created_at":"2026-08-16T17:08:14.062Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.064Z","job_size_bytes":66,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-991d881b5e195fec67bfc756: done: 0.038673 sec","job_status":"done","queue_duration_s":0.513274,"scheduling_latency_s":0.513302,"redis_calls":7,"redis_duration_s":0.001761,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000533,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038673,"completed_at":"2026-08-16T17:08:14.616Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007893,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 444.436603] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.618Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c2d27ab083f1aaa136a8287e","created_at":"2026-08-16T17:08:14.065Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.066Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c2d27ab083f1aaa136a8287e: start","job_status":"start","queue_duration_s":0.551623,"scheduling_latency_s":0.551648} gitlab # [ 444.452837] gitaly[923]: time="2026-08-16T17:08:14.082Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:08:44.081" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:14.081" grpc.time_ms=0.746 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 444.465162] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.653Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"c2d27ab083f1aaa136a8287e","created_at":"2026-08-16T17:08:14.065Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.066Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-c2d27ab083f1aaa136a8287e: done: 0.035101 sec","job_status":"done","queue_duration_s":0.551623,"scheduling_latency_s":0.551648,"redis_calls":7,"redis_duration_s":0.001478,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000384,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035101,"completed_at":"2026-08-16T17:08:14.653Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006771,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 444.508089] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.655Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"27dc89857bd08e384d517c76","created_at":"2026-08-16T17:08:14.067Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.068Z","job_size_bytes":6,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-27dc89857bd08e384d517c76: start","job_status":"start","queue_duration_s":0.586649,"scheduling_latency_s":0.586673} gitlab # [ 444.523693] gitaly[923]: time="2026-08-16T17:08:14.118Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ5D88WJ91F0Z0M3TANXF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:44.117" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:14.117" grpc.time_ms=0.845 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 444.535856] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.678Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"27dc89857bd08e384d517c76","created_at":"2026-08-16T17:08:14.067Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.068Z","job_size_bytes":6,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-27dc89857bd08e384d517c76: done: 0.023002 sec","job_status":"done","queue_duration_s":0.586649,"scheduling_latency_s":0.586673,"redis_calls":7,"redis_duration_s":0.005855,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001169,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023002,"completed_at":"2026-08-16T17:08:14.678Z","load_balancing_strategy":"primary","db_duration_s":0.000412,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 444.576963] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.679Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3ede9258755e9bd780380f3e","created_at":"2026-08-16T17:08:14.063Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-3c491c18a78f4370","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.068Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3ede9258755e9bd780380f3e: start","job_status":"start","queue_duration_s":0.611238,"scheduling_latency_s":0.611264} gitlab # [ 444.593358] gitaly[923]: time="2026-08-16T17:08:14.676Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ7M4ECQRGC3KQTZW8Y6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:44.475" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:14.676" grpc.time_ms=0.645 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 444.605660] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.711Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3ede9258755e9bd780380f3e","created_at":"2026-08-16T17:08:14.063Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-3c491c18a78f4370","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.068Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3ede9258755e9bd780380f3e: done: 0.031859 sec","job_status":"done","queue_duration_s":0.611238,"scheduling_latency_s":0.611264,"redis_calls":7,"redis_duration_s":0.001201,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000818,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000383,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022591,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.031859,"completed_at":"2026-08-16T17:08:14.711Z","load_balancing_strategy":"primary","db_duration_s":0.004718,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 444.647443] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.713Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9ef025a683f24c0cddc90a62","created_at":"2026-08-16T17:08:14.069Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.070Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9ef025a683f24c0cddc90a62: start","job_status":"start","queue_duration_s":0.642439,"scheduling_latency_s":0.642466} gitlab # [ 444.662495] gitaly[923]: time="2026-08-16T17:08:14.916Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:08:44.614" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:14.914" grpc.time_ms=1.352 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 444.675101] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.737Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"9ef025a683f24c0cddc90a62","created_at":"2026-08-16T17:08:14.069Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.070Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-9ef025a683f24c0cddc90a62: done: 0.024873 sec","job_status":"done","queue_duration_s":0.642439,"scheduling_latency_s":0.642466,"redis_calls":7,"redis_duration_s":0.001183,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000888,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024873,"completed_at":"2026-08-16T17:08:14.737Z","load_balancing_strategy":"primary","db_duration_s":0.003049,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 444.716977] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.742Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6eabcf1b49086ef98e3eeaae","created_at":"2026-08-16T17:08:14.069Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-3c491c18a78f4370","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.073Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6eabcf1b49086ef98e3eeaae: start","job_status":"start","queue_duration_s":0.668574,"scheduling_latency_s":0.668601} gitlab # [ 444.734219] gitaly[923]: time="2026-08-16T17:08:14.964Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ6TMHDKTK0ZRJ4W5FX89 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:44.662" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:14.963" grpc.time_ms=1.522 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 444.746411] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.801Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"6eabcf1b49086ef98e3eeaae","created_at":"2026-08-16T17:08:14.069Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-3c491c18a78f4370","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.073Z","job_size_bytes":65,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-6eabcf1b49086ef98e3eeaae: done: 0.059478 sec","job_status":"done","queue_duration_s":0.668574,"scheduling_latency_s":0.668601,"redis_calls":10,"redis_duration_s":0.001968,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000948,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.00102,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.059478,"completed_at":"2026-08-16T17:08:14.801Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013003,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 444.789920] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.803Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"70cf151e3782761f093f8da5","created_at":"2026-08-16T17:08:14.128Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.130Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-70cf151e3782761f093f8da5: start","job_status":"start","queue_duration_s":0.673006,"scheduling_latency_s":0.673025} gitlab # [ 444.805414] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.831Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"70cf151e3782761f093f8da5","created_at":"2026-08-16T17:08:14.128Z","trace_propagation_headers":{"sentry-trace":"309b8ba34f5c4bca9a2e493643ca26f8-159836220e1d4dc4","baggage":"sentry-trace_id=309b8ba34f5c4bca9a2e493643ca26f8,sentry-release=Unknown"},"correlation_id":"01M05RQ5D88WJ91F0Z0M3TANXF","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.130Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-70cf151e3782761f093f8da5: done: 0.028649 sec","job_status":"done","queue_duration_s":0.673006,"scheduling_latency_s":0.673025,"redis_calls":8,"redis_duration_s":0.001747,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001356,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000391,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019167,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.028649,"completed_at":"2026-08-16T17:08:14.831Z","load_balancing_strategy":"primary","db_duration_s":0.004863,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 444.846704] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.833Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"95290fcb1cdd92c84edc78fb","created_at":"2026-08-16T17:08:14.146Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-3c491c18a78f4370","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.149Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-95290fcb1cdd92c84edc78fb: start","job_status":"start","queue_duration_s":0.683251,"scheduling_latency_s":0.683269} gitlab # [ 444.862408] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.976Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"95290fcb1cdd92c84edc78fb","created_at":"2026-08-16T17:08:14.146Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-3c491c18a78f4370","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.149Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-95290fcb1cdd92c84edc78fb: done: 0.143295 sec","job_status":"done","queue_duration_s":0.683251,"scheduling_latency_s":0.683269,"gitaly_calls":2,"gitaly_duration_s":0.008022,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.008256,"redis_read_bytes":79,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.00142,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001169,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000319,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001903,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.00035,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000613,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.006,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.017,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.092245,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.11056952,"duration_s":0.143295,"completed_at":"2026-08-16T17:08:14.976Z","load_balancing_strategy":"primary","db_duration_s":0.043133,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 444.914029] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:14.977Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"9a923174d4848631a6c6efef","created_at":"2026-08-16T17:08:14.896Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-d78cdf31f06a4f89","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.898Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9a923174d4848631a6c6efef: start","job_status":"start","queue_duration_s":0.07941,"scheduling_latency_s":0.079427} gitlab # [ 444.929962] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:15.015Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"9a923174d4848631a6c6efef","created_at":"2026-08-16T17:08:14.896Z","trace_propagation_headers":{"sentry-trace":"e4205a2a16474f09bf7e9d004532b7f4-d78cdf31f06a4f89","baggage":"sentry-trace_id=e4205a2a16474f09bf7e9d004532b7f4,sentry-release=Unknown"},"correlation_id":"01M05RQ6TMHDKTK0ZRJ4W5FX89","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:14.898Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-9a923174d4848631a6c6efef: done: 0.037271 sec","job_status":"done","queue_duration_s":0.07941,"scheduling_latency_s":0.079427,"redis_calls":7,"redis_duration_s":0.0019459999999999998,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001377,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037271,"completed_at":"2026-08-16T17:08:15.015Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008051,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses gitlab # [ 445.254123] gitaly[923]: time="2026-08-16T17:08:15.918Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQ8T4VDWCMSS8N42VCVXF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:45.016" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:15.917" grpc.time_ms=1.338 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses, in 0.25 seconds) gitlab # [ 445.310128] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:15 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 162 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses gitlab # [ 446.488736] gitaly[923]: time="2026-08-16T17:08:17.153Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQA0BGFVVWBMMY08JB3MA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:47.151" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:17.152" grpc.time_ms=1.256 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses, in 0.24 seconds) gitlab # [ 446.554453] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:17 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 183 gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses gitlab # [ 447.704148] gitaly[923]: time="2026-08-16T17:08:18.368Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQB72VRYF5SBWDCJF1BJV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:48.366" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:18.367" grpc.time_ms=1.425 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 447.751936] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:18 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 142 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses, in 0.20 seconds) gitlab # [ 448.640495] gitaly[923]: time="2026-08-16T17:08:19.306Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:49.303" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:19.304" grpc.time_ms=1.407 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses gitlab # [ 448.742370] gitaly[923]: time="2026-08-16T17:08:19.407Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:29.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.387" grpc.time_ms=19.731 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 448.838056] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:19.501Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b5d60fa253f19d1916354f78","created_at":"2026-08-16T17:08:19.490Z","trace_propagation_headers":{"sentry-trace":"a29b06fdc69d469fbe3dcba7336611e1-0df0fa651d564429","baggage":"sentry-trace_id=a29b06fdc69d469fbe3dcba7336611e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQC3ST7K61XFWATCC2J0R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.497Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b5d60fa253f19d1916354f78: start","job_status":"start","queue_duration_s":0.00305,"scheduling_latency_s":0.003123} gitlab # [ 448.883751] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 342 gitlab # [ 448.890465] nixbot[3635]: {"ts": "2026-08-16T17:08:19.540Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 \"HTTP/1.1 201 Created\""} gitlab # [ 448.896271] gitaly[923]: time="2026-08-16T17:08:19.551Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQCCKQ8K03G59QGD0XR2H grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:49.350" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:19.550" grpc.time_ms=0.886 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 448.926042] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:19 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses HTTP/1.1" 200 671 "" "curl/8.21.0" 116 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses, in 0.18 seconds) gitlab # [ 448.996909] gitaly[923]: time="2026-08-16T17:08:19.662Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQCF2R9MJC9ZDHB6ZVGZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:49.660" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:19.661" grpc.time_ms=1.246 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.076345] gitaly[923]: time="2026-08-16T17:08:19.742Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M05RQCF2R9MJC9ZDHB6ZVGZZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:29.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.722" grpc.time_ms=19.358 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.188348] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 296 gitlab # [ 449.191396] nixbot[3635]: {"ts": "2026-08-16T17:08:19.852Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 \"HTTP/1.1 201 Created\""} gitlab # [ 449.256171] gitaly[923]: time="2026-08-16T17:08:19.922Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:19.920" grpc.time_ms=1.602 pid=923 span.kind=server system=grpc gitlab # [ 449.304664] gitaly[923]: time="2026-08-16T17:08:19.970Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:19.969" grpc.time_ms=1.333 pid=923 span.kind=server system=grpc gitlab # [ 449.326056] gitaly[923]: time="2026-08-16T17:08:19.985Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQCS3D1Z0J180C162HCNR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:49.083" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:19.984" grpc.time_ms=1.005 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.358432] gitaly[923]: time="2026-08-16T17:08:20.024Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-16T17:08:20.023" grpc.time_ms=0.638 pid=923 span.kind=server system=grpc gitlab # [ 449.375847] gitaly[923]: time="2026-08-16T17:08:20.037Z" level=info msg="beginning scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R forced=false grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:49.571" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.872" operations="[repack_refs]" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.394531] gitaly[923]: time="2026-08-16T17:08:20.041Z" level=info msg="repository info" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:49.571" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.872" pid=923 remote_ip="2001:db8:1::1" repository_info="{false {6 701 0 0 0 0} {0 0 0 0 0 0 0 0 0 {false 0 false false} {false 0 0 false false false} {false 0 false false} 2026-08-16 17:06:35.55614392 +0000 UTC} {3 0 [] 0 files} {false 0 false false false} {false [] 0001-01-01 00:00:00 +0000 UTC }}" span.kind=server system=grpc username=root gitlab # [ 449.409269] gitaly[923]: time="2026-08-16T17:08:20.047Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R diskcache=a5ec4f81-ab37-495b-85d4-b7486a9b98ef grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:49.571" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.872" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.419803] gitaly[923]: time="2026-08-16T17:08:20.047Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=124 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7169 command.oublock=0 command.real_time_ms=162 command.spawn_token_fork_ms=2 command.system_time_ms=81 command.user_time_ms=43 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:49.571" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.872" grpc.time_ms=175.228 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.433056] gitaly[923]: time="2026-08-16T17:08:20.056Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01M05RQCS3D1Z0J180C162HCNR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-16T17:08:30.022" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:20.042" grpc.time_ms=14.06 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.447183] gitaly[923]: time="2026-08-16T17:08:20.071Z" level=info msg="removed files" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:49.571" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.872" pid=923 remote_ip="2001:db8:1::1" span.kind=server stale_data.configfullpath=0 stale_data.configkeys=0 stale_data.configsections=0 stale_data.infoattributes=0 stale_data.locks=0 stale_data.objectdirs=0 stale_data.objects=0 stale_data.packedrefslock=0 stale_data.packedrefsnew=0 stale_data.packfilelocks=0 stale_data.reflocks=0 stale_data.refs=0 stale_data.refsemptydir=0 stale_data.reftablelocks=0 stale_data.serverinfo=0 system=grpc username=root gitlab # [ 449.460592] gitaly[923]: time="2026-08-16T17:08:20.071Z" level=info msg="optimized repository" clean_stale_data_time=29.39546ms clean_work_trees_time="155.94µs" commit_graph_time=740ns correlation_id=01M05RQC3ST7K61XFWATCC2J0R gl_project_path=root/test-flake gl_repo=project-1 optimizations="map[]" pack_refs_time="1.62µs" pid=923 prune_time=260ns relative_path=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git repack_time="1.48µs" storage_name=default system=housekeeping total_time=29.60994ms gitlab # [ 449.466161] gitaly[923]: time="2026-08-16T17:08:20.071Z" level=info msg="ended scheduled housekeeping" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-16T17:08:49.571" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-16T17:08:19.872" pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.475446] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:20 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 256 gitlab # [ 449.478081] nixbot[3635]: {"ts": "2026-08-16T17:08:20.133Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1 \"HTTP/1.1 201 Created\""} gitlab # [ 449.572591] nix-daemon[3858]: accepted connection from pid 4622, user nixbot gitlab # [ 449.599252] gitaly[923]: time="2026-08-16T17:08:20.265Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-16T17:08:50.263" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:20.263" grpc.time_ms=1.288 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.671683] gitaly[923]: time="2026-08-16T17:08:20.337Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQC3ST7K61XFWATCC2J0R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:50.035" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:20.336" grpc.time_ms=0.969 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.714442] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.379Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"659c72f32613cfcff4886959","created_at":"2026-08-16T17:08:20.369Z","trace_propagation_headers":{"sentry-trace":"a29b06fdc69d469fbe3dcba7336611e1-5f2ce446a2434b3d","baggage":"sentry-trace_id=a29b06fdc69d469fbe3dcba7336611e1,sentry-release=Unknown"},"correlation_id":"01M05RQC3ST7K61XFWATCC2J0R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","duplicate-of":"b5d60fa253f19d1916354f78","job_size_bytes":3,"pid":3532,"job_status":"deduplicated","message":"PipelineProcessWorker JID-659c72f32613cfcff4886959: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60} gitlab # [ 449.742998] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.386Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b5d60fa253f19d1916354f78","created_at":"2026-08-16T17:08:19.490Z","trace_propagation_headers":{"sentry-trace":"a29b06fdc69d469fbe3dcba7336611e1-0df0fa651d564429","baggage":"sentry-trace_id=a29b06fdc69d469fbe3dcba7336611e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQC3ST7K61XFWATCC2J0R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.497Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3532,"job_status":"rescheduled","message":"PipelineProcessWorker JID-b5d60fa253f19d1916354f78: rescheduled"} gitlab # [ 449.763965] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:20 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 69 gitlab # [ 449.767000] gitaly[923]: time="2026-08-16T17:08:20.385Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M05RQD6W1G54ZBS13DQK8MQ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:20.374" grpc.time_ms=10.961 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 449.782618] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.416Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"b5d60fa253f19d1916354f78","created_at":"2026-08-16T17:08:19.490Z","trace_propagation_headers":{"sentry-trace":"a29b06fdc69d469fbe3dcba7336611e1-0df0fa651d564429","baggage":"sentry-trace_id=a29b06fdc69d469fbe3dcba7336611e1,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M05RQC3ST7K61XFWATCC2J0R","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.497Z","job_size_bytes":3,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-b5d60fa253f19d1916354f78: done: 0.915293 sec","job_status":"done","queue_duration_s":0.00305,"scheduling_latency_s":0.003123,"gitaly_calls":3,"gitaly_duration_s":0.205014,"redis_calls":79,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.09288,"redis_read_bytes":247,"redis_write_bytes":21779,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001725,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":11,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.002597,"redis_cache_read_bytes":20,"redis_cache_write_bytes":948,"redis_queues_calls":25,"redis_queues_duration_s":0.043326,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14464,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.035098,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001969,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001285,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.005155,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.173,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":17,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.014,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.017,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.072,"db_ci_duration_s":0.101,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.418956,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.7566695,"duration_s":0.915293,"completed_at":"2026-08-16T17:08:20.416Z","load_balancing_strategy":"primary","db_duration_s":0.176552,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 449.835507] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.418Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"43762e2ad52be8775d2055e1","created_at":"2026-08-16T17:08:19.851Z","trace_propagation_headers":{"sentry-trace":"a29b06fdc69d469fbe3dcba7336611e1-5f2ce446a2434b3d","baggage":"sentry-trace_id=a29b06fdc69d469fbe3dcba7336611e1,sentry-release=Unknown"},"correlation_id":"01M05RQC3ST7K61XFWATCC2J0R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.858Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-43762e2ad52be8775d2055e1: start","job_status":"start","queue_duration_s":0.560075,"scheduling_latency_s":0.560106} gitlab # [ 449.852161] gitaly[923]: time="2026-08-16T17:08:20.500Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M05RQD9491R25W94PGVM0R82 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:20.485" pid=923 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 449.861854] gitlab-workhorse[825]: time="2026-08-16T17:08:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 449.863601] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:20 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 113 gitlab # [ 449.865606] gitaly[923]: time="2026-08-16T17:08:20.501Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQD9491R25W94PGVM0R82 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:20.485" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 449.878937] gitaly[923]: time="2026-08-16T17:08:20.502Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQD9491R25W94PGVM0R82 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-16T17:08:20.485" grpc.time_ms=15.849 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses gitlab # [ 449.978055] nix-daemon[3858]: accepted connection from pid 4647, user nixbot gitlab # [ 449.999964] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.664Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["2","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"43762e2ad52be8775d2055e1","created_at":"2026-08-16T17:08:19.851Z","trace_propagation_headers":{"sentry-trace":"a29b06fdc69d469fbe3dcba7336611e1-5f2ce446a2434b3d","baggage":"sentry-trace_id=a29b06fdc69d469fbe3dcba7336611e1,sentry-release=Unknown"},"correlation_id":"01M05RQC3ST7K61XFWATCC2J0R","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8bfbfb5f73a204e3fdd48256b83d50aefe68bf2f3ce2656861732de8a412dec3","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.858Z","job_size_bytes":23,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-43762e2ad52be8775d2055e1: done: 0.246275 sec","job_status":"done","queue_duration_s":0.560075,"scheduling_latency_s":0.560106,"redis_calls":7,"redis_duration_s":0.014061,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003244,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.113,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.078,"db_ci_duration_s":0.036,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.246275,"completed_at":"2026-08-16T17:08:20.664Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.113113,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 450.081821] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.666Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"4a327560e134b8a6db44400b","created_at":"2026-08-16T17:08:19.824Z","trace_propagation_headers":{"sentry-trace":"32d9ebaaf27a442880437dab01dd0b6f-b02139a26a8d4a04","baggage":"sentry-trace_id=32d9ebaaf27a442880437dab01dd0b6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3c03113e46622c5f7bb3b8100daf8d8","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.898Z","job_size_bytes":2,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-4a327560e134b8a6db44400b: start","job_status":"start","queue_duration_s":0.767266,"scheduling_latency_s":0.767332} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses, in 0.19 seconds) (finished: subtest: eval and build post commit statuses, in 6.23 seconds) (finished: run the VM test script, in 525.09 seconds) gitlab # [ 450.098972] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"4a327560e134b8a6db44400b","created_at":"2026-08-16T17:08:19.824Z","trace_propagation_headers":{"sentry-trace":"32d9ebaaf27a442880437dab01dd0b6f-b02139a26a8d4a04","baggage":"sentry-trace_id=32d9ebaaf27a442880437dab01dd0b6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d3c03113e46622c5f7bb3b8100daf8d8","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.898Z","job_size_bytes":2,"pid":3532,"sidekiq_tid":"m8pw","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-4a327560e134b8a6db44400b: done: 0.032926 sec","job_status":"done","queue_duration_s":0.767266,"scheduling_latency_s":0.767332,"redis_calls":9,"redis_duration_s":0.0017109999999999998,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000323,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001003,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000385,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032926,"completed_at":"2026-08-16T17:08:20.699Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004702,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 450.142146] gitaly[923]: time="2026-08-16T17:08:20.734Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M05RQDHNFM5N9XG6VH14ST2E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-16T17:08:50.533" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-16T17:08:20.733" grpc.time_ms=0.983 pid=923 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 450.157036] gitlab-workhorse[825]: gitlab 2001:db8:1::1 - - [2026/08/16:17:08:20 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/4d08eaf3d0520ce6ede23381e4a7abb44d0744a1/statuses HTTP/1.1" 200 1328 "" "curl/8.21.0" 125 test script finished in 525.13s cleanup kill QemuMachine (pid 46) gitlab # [ 450.160861] sidekiq-cluster[3532]: {"severity":"INFO","time":"2026-08-16T17:08:20.700Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"17483584dbe971f5024d930d","created_at":"2026-08-16T17:08:19.908Z","trace_propagation_headers":{"sentry-trace":"32d9ebaaf27a442880437dab01dd0b6f-b02139a26a8d4a04","baggage":"sentry-trace_id=32d9ebaaf27a442880437dab01dd0b6f,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d401cdd8537946c05c599e96096ae933","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-16T17:08:19.919Zqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14) (finished: cleanup, in 1.50 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-16T17:06:43.620Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-16T17:08:13.764506Z', 'started_at': '2026-08-16T17:08:14.173085Z', 'finished_at': None}] [{'id': 5, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T17:08:14.138Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T17:08:14.138Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T17:08:14.138Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-16T17:08:14.138Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-16T17:08:14.138Z', 'started_at': None, 'finished_at': '2026-08-16T17:08:19.466Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-16T17:08:14.138Z', 'started_at': None, 'finished_at': '2026-08-16T17:08:19.466Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '4d08eaf3d0520ce6ede23381e4a7abb44d0744a1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-16T17:08:19.796Z', 'started_at': None, 'finished_at': '2026-08-16T17:08:20.094Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]