tribuchet: building on eliza Machine state will be reset. To keep it, pass --keep-machine-state start all VLans (finished: start all VLans, in 0.00 seconds) Test will time out and terminate in 3600 seconds run the VM test script start all VMs gitlab: starting vm gitlab # Disk image does not exist, creating the virtualisation disk image... gitlab: QEMU running (pid 46) gitlab # Formatting '/build/vm-state-gitlab/tmp.8eZFG538cT', fmt=raw size=1073741824 gitlab # mke2fs 1.47.4 (6-Mar-2025) gitlab # Discarding device blocks: 0/262144 done gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes (finished: start all VMs, in 70.87 seconds) gitlab # Filesystem UUID: 2b4a6797-199c-4c53-8784-9f07d5d332e7 gitlab: waiting for unit setup-gitlab.service gitlab # Superblock backups stored on blocks: gitlab: waiting for the VM to finish booting gitlab # 32768, 98304, 163840, 229376 gitlab # gitlab # Allocating group tables: 0/8 done gitlab # Writing inode tables: 0/8 done gitlab # Creating journal (8192 blocks): done gitlab # Writing superblocks and filesystem accounting information: 0/8 done gitlab # gitlab # Virtualisation disk image created. gitlab # Creating Nix store image... gitlab # Created Nix store image. gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40] gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 2026 gitlab # [ 0.000000] KASLR enabled gitlab # [ 0.000000] random: crng init done gitlab # [ 0.000000] Machine model: linux,dummy-virt gitlab # [ 0.000000] efi: UEFI not found. gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf] gitlab # [ 0.000000] Zone ranges: gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff] gitlab # [ 0.000000] DMA32 empty gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff] gitlab # [ 0.000000] Device empty gitlab # [ 0.000000] Movable zone start for each node gitlab # [ 0.000000] Early memory node ranges gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff] gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe000000 gitlab # [ 0.000000] psci: probing for conduit method from DT. gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware. gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs gitlab # [ 0.000000] psci: Trusted OS migration not required gitlab # [ 0.000000] psci: SMC Calling Convention v1.1 gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003) gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u311296 gitlab # [ 0.000000] Detected PIPT I-cache on CPU0 gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm) gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface gitlab # [ 0.000000] CPU features: detected: Spectre-v4 gitlab # [ 0.000000] CPU features: detected: Spectre-BHB gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38 gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23 gitlab # [ 0.000000] alternatives: applying boot alternatives gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/cvhdmd78nk8ap6q3mi6qhlfw2rq7knjk-nixos-system-gitlab-test/init regInfo=/nix/store/y3f6il9nynrji5pf051rrb6wyyp27las-closure-info/registration console=ttyAMA0,115200n8 console=tty0 gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/y3f6il9nynrji5pf051rrb6wyyp27las-closure-info/registration", will be passed to user space. gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear) gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear) gitlab # [ 0.000000] software IO TLB: area num 4. gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB) gitlab # [ 0.000000] Fallback order for Node 0: 0 gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 1572864 gitlab # [ 0.000000] Policy zone: Normal gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1 gitlab # [ 0.000000] allocated 12582912 bytes of page_ext gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups gitlab # [ 0.000000] rcu: Hierarchical RCU implementation. gitlab # [ 0.000000] rcu: RCU event tracing is enabled. gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4. gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled. gitlab # [ 0.000000] Rude variant of Tasks RCU enabled. gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled. gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4 gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4. gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0 gitlab # [ 0.000000] GICv3: 256 SPIs implemented gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0 gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000 gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff] gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1) gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000 gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000 gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention. gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt). gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns gitlab # [ 0.000030] arm-pv: using stolen time PV gitlab # [ 0.000404] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____) gitlab # [ 0.000602] Console: colour dummy device 80x25 gitlab # [ 0.000609] printk: legacy console [tty0] enabled gitlab # [ 0.000798] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000) gitlab # [ 0.000805] pid_max: default: 32768 minimum: 301 gitlab # [ 0.000887] LSM: initializing lsm=capability,landlock,yama,bpf,ima gitlab # [ 0.001024] landlock: Up and running. gitlab # [ 0.001027] Yama: becoming mindful. gitlab # [ 0.001482] LSM support for eBPF active gitlab # [ 0.001690] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.001793] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear) gitlab # [ 0.002926] cacheinfo: Unable to detect cache hierarchy for CPU 0 gitlab # [ 0.003587] rcu: Hierarchical SRCU implementation. gitlab # [ 0.003591] rcu: Max phase no-delay instances is 1000. gitlab # [ 0.003736] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level gitlab # [ 0.004798] fsl-mc MSI: its@8080000 domain created gitlab # [ 0.004895] EFI services will not be available. gitlab # [ 0.005098] smp: Bringing up secondary CPUs ... gitlab # [ 0.005739] Detected PIPT I-cache on CPU1 gitlab # [ 0.005839] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000 gitlab # [ 0.005962] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000 gitlab # [ 0.006086] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40] gitlab # [ 0.007183] Detected PIPT I-cache on CPU2 gitlab # [ 0.007290] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000 gitlab # [ 0.007413] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000 gitlab # [ 0.007537] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40] gitlab # [ 0.008582] Detected PIPT I-cache on CPU3 gitlab # [ 0.008709] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000 gitlab # [ 0.008830] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000 gitlab # [ 0.008953] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40] gitlab # [ 0.009435] smp: Brought up 1 node, 4 CPUs gitlab # [ 0.009461] SMP: Total of 4 processors activated. gitlab # [ 0.009463] CPU: All CPU(s) started at EL1 gitlab # [ 0.009472] CPU features: detected: Branch Target Identification gitlab # [ 0.009475] CPU features: detected: ARMv8.4 Translation Table Level gitlab # [ 0.009478] CPU features: detected: Instruction cache invalidation not required for I/D coherence gitlab # [ 0.009482] CPU features: detected: Data cache clean to the PoU not required for I/D coherence gitlab # [ 0.009485] CPU features: detected: Common not Private translations gitlab # [ 0.009487] CPU features: detected: CRC32 instructions gitlab # [ 0.009490] CPU features: detected: Data cache clean to Point of Deep Persistence gitlab # [ 0.009493] CPU features: detected: Data cache clean to Point of Persistence gitlab # [ 0.009496] CPU features: detected: Data independent timing control (DIT) gitlab # [ 0.009499] CPU features: detected: E0PD gitlab # [ 0.009501] CPU features: detected: Enhanced Counter Virtualization gitlab # [ 0.009504] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF) gitlab # [ 0.009507] CPU features: detected: Enhanced Virtualization Traps gitlab # [ 0.009509] CPU features: detected: Fine Grained Traps gitlab # [ 0.009512] CPU features: detected: Generic authentication (architected QARMA5 algorithm) gitlab # [ 0.009517] CPU features: detected: RCpc load-acquire (LDAPR) gitlab # [ 0.009519] CPU features: detected: LSE atomic instructions gitlab # [ 0.009522] CPU features: detected: Privileged Access Never gitlab # [ 0.009525] CPU features: detected: PMUv3 gitlab # [ 0.009527] CPU features: detected: RAS Extension Support gitlab # [ 0.009530] CPU features: detected: RASv1p1 Extension Support gitlab # [ 0.009532] CPU features: detected: Random Number Generator gitlab # [ 0.009535] CPU features: detected: Speculation barrier (SB) gitlab # [ 0.009537] CPU features: detected: Stage-2 Force Write-Back gitlab # [ 0.009540] CPU features: detected: TLB range maintenance instructions gitlab # [ 0.009544] CPU features: detected: Speculative Store Bypassing Safe (SSBS) gitlab # [ 0.009663] alternatives: applying system-wide alternatives gitlab # [ 0.012659] CPU features: detected: BBM Level 2 without TLB conflict abort gitlab # [ 0.012866] Memory: 5963800K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved) gitlab # [ 0.014345] devtmpfs: initialized gitlab # [ 0.018206] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear) gitlab # [ 0.018269] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear). gitlab # [ 0.018466] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL gitlab # [ 0.018470] 0 pages in range for non-PLT usage gitlab # [ 0.018472] 508288 pages in range for PLT usage gitlab # [ 0.018597] pinctrl core: initialized pinctrl subsystem gitlab # [ 0.019446] DMI not present or invalid. gitlab # [ 0.022618] NET: Registered PF_NETLINK/PF_ROUTE protocol family gitlab # [ 0.025119] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations gitlab # [ 0.025405] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations gitlab # [ 0.027116] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations gitlab # [ 0.027140] audit: initializing netlink subsys (disabled) gitlab # [ 0.027512] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1 gitlab # [ 0.027968] thermal_sys: Registered thermal governor 'fair_share' gitlab # [ 0.027971] thermal_sys: Registered thermal governor 'bang_bang' gitlab # [ 0.027975] thermal_sys: Registered thermal governor 'step_wise' gitlab # [ 0.027978] thermal_sys: Registered thermal governor 'user_space' gitlab # [ 0.027981] thermal_sys: Registered thermal governor 'power_allocator' gitlab # [ 0.028077] cpuidle: using governor ladder gitlab # [ 0.028101] cpuidle: using governor menu gitlab # [ 0.028293] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers. gitlab # [ 0.028500] ASID allocator initialised with 65536 entries gitlab # [ 0.029599] Serial: AMBA PL011 UART driver gitlab # [ 0.034716] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1 gitlab # [ 0.035041] printk: console [ttyAMA0] enabled gitlab # [ 0.045168] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages gitlab # [ 0.045190] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page gitlab # [ 0.045199] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages gitlab # [ 0.045208] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page gitlab # [ 0.045216] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages gitlab # [ 0.045224] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page gitlab # [ 0.045232] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages gitlab # [ 0.045240] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page gitlab # [ 0.058944] fbcon: Taking over console gitlab # [ 0.058957] ACPI: Interpreter disabled. gitlab # [ 0.059932] iommu: Default domain type: Translated gitlab # [ 0.059948] iommu: DMA domain TLB invalidation policy: strict mode gitlab # [ 0.069668] SCSI subsystem initialized gitlab # [ 0.070030] usbcore: registered new interface driver usbfs gitlab # [ 0.070062] usbcore: registered new interface driver hub gitlab # [ 0.070080] usbcore: registered new device driver usb gitlab # [ 0.070360] pps_core: LinuxPPS API ver. 1 registered gitlab # [ 0.070364] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti gitlab # [ 0.070373] PTP clock support registered gitlab # [ 0.070421] EDAC MC: Ver: 3.0.0 gitlab # [ 0.070941] scmi_core: SCMI protocol bus registered gitlab # [ 0.071871] FPGA manager framework gitlab # [ 0.072654] vgaarb: loaded gitlab # [ 0.074862] clocksource: Switched to clocksource arch_sys_counter gitlab # [ 0.075300] VFS: Disk quotas dquot_6.6.0 gitlab # [ 0.075323] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) gitlab # [ 0.077374] netfs: FS-Cache loaded gitlab # [ 0.077486] pnp: PnP ACPI: disabled gitlab # [ 0.085960] NET: Registered PF_INET protocol family gitlab # [ 0.086852] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear) gitlab # [ 0.115141] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear) gitlab # [ 0.115193] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear) gitlab # [ 0.115243] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear) gitlab # [ 0.115558] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear) gitlab # [ 0.116109] TCP: Hash tables configured (established 65536 bind 65536) gitlab # [ 0.116219] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear) gitlab # [ 0.116278] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.116392] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear) gitlab # [ 0.116555] NET: Registered PF_UNIX/PF_LOCAL protocol family gitlab # [ 0.116610] NET: Registered PF_XDP protocol family gitlab # [ 0.116628] PCI: CLS 0 bytes, default 64 gitlab # [ 0.116956] Trying to unpack rootfs image as initramfs... gitlab # [ 0.127009] kvm [1]: HYP mode not available gitlab # [ 0.172291] Initialise system trusted keyrings gitlab # [ 0.172498] workingset: timestamp_bits=42 max_order=21 bucket_order=0 gitlab # [ 0.174792] squashfs: version 4.0 (2009/01/31) Phillip Lougher gitlab # [ 0.175064] 9p: Installing v9fs 9p2000 file system support gitlab # [ 0.213724] Key type asymmetric registered gitlab # [ 0.213735] Asymmetric key parser 'x509' registered gitlab # [ 0.213991] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242) gitlab # [ 0.214408] io scheduler mq-deadline registered gitlab # [ 0.214421] io scheduler kyber registered gitlab # [ 0.225730] pl061_gpio 9030000.pl061: PL061 GPIO chip registered gitlab # [ 0.231045] ledtrig-cpu: registered to indicate activity on CPUs gitlab # [ 0.232498] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges: gitlab # [ 0.232565] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000 gitlab # [ 0.232594] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000 gitlab # [ 0.232610] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000 gitlab # [ 0.232674] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits gitlab # [ 0.232751] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff] gitlab # [ 0.233122] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00 gitlab # [ 0.233142] pci_bus 0000:00: root bus resource [bus 00-ff] gitlab # [ 0.233177] pci_bus 0000:00: root bus resource [io 0x0000-0xffff] gitlab # [ 0.233188] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff] gitlab # [ 0.233198] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff] gitlab # [ 0.233469] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint gitlab # [ 0.235055] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.235757] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.235795] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.235888] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.235924] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.237463] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.238125] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.238160] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.238239] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.239826] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.240512] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.240547] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.240638] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.242238] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint gitlab # [ 0.242927] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.242963] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.243054] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.244646] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.245322] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.245357] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.245447] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.247079] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint gitlab # [ 0.247744] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f] gitlab # [ 0.247779] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.247857] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.249457] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint gitlab # [ 0.250101] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.250136] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.250227] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.250262] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref] gitlab # [ 0.251943] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint gitlab # [ 0.252649] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.252743] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.254287] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint gitlab # [ 0.254965] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.255046] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.256385] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint gitlab # [ 0.257060] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff] gitlab # [ 0.257859] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint gitlab # [ 0.258600] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f] gitlab # [ 0.258635] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.258714] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.260303] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint gitlab # [ 0.260969] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f] gitlab # [ 0.261004] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff] gitlab # [ 0.261096] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref] gitlab # [ 0.263014] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned gitlab # [ 0.263033] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned gitlab # [ 0.263044] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned gitlab # [ 0.263193] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned gitlab # [ 0.263332] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned gitlab # [ 0.263475] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned gitlab # [ 0.263618] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned gitlab # [ 0.263766] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned gitlab # [ 0.263899] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned gitlab # [ 0.264052] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned gitlab # [ 0.264206] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned gitlab # [ 0.264349] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned gitlab # [ 0.264515] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned gitlab # [ 0.264655] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned gitlab # [ 0.264723] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned gitlab # [ 0.264776] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned gitlab # [ 0.264828] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned gitlab # [ 0.264894] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned gitlab # [ 0.264949] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned gitlab # [ 0.265014] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned gitlab # [ 0.265069] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned gitlab # [ 0.265137] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned gitlab # [ 0.265192] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned gitlab # [ 0.265247] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned gitlab # [ 0.265304] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned gitlab # [ 0.265359] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned gitlab # [ 0.265411] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned gitlab # [ 0.265465] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned gitlab # [ 0.265516] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned gitlab # [ 0.265569] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned gitlab # [ 0.265625] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned gitlab # [ 0.265677] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned gitlab # [ 0.265733] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned gitlab # [ 0.265790] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned gitlab # [ 0.265856] pci_bus 0000:00: resource 4 [io 0x0000-0xffff] gitlab # [ 0.265871] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff] gitlab # [ 0.265881] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff] gitlab # [ 0.270022] pci 0000:00:0a.0: enabling device (0000 -> 0002) gitlab # [ 0.298285] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003) gitlab # [ 0.302474] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003) gitlab # [ 0.306363] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003) gitlab # [ 0.311199] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003) gitlab # [ 0.315849] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003) gitlab # [ 0.319690] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003) gitlab # [ 0.324579] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003) gitlab # [ 0.329536] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002) gitlab # [ 0.333519] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002) gitlab # [ 0.338309] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003) gitlab # [ 0.343597] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003) gitlab # [ 0.358917] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled gitlab # [ 0.364344] msm_serial: driver initialized gitlab # [ 0.364791] SuperH (H)SCI(F) driver initialized gitlab # [ 0.364941] STM32 USART driver initialized gitlab # [ 0.409164] loop: module loaded gitlab # [ 0.409709] virtio_blk virtio4: 4/0/0 default/read/poll queues gitlab # [ 0.414946] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB) gitlab # [ 0.419596] virtio_blk virtio5: 4/0/0 default/read/poll queues gitlab # [ 0.423865] virtio_blk virtio5: [vdb] 12204216 512-byte logical blocks (6.25 GB/5.82 GiB) gitlab # [ 0.428890] megasas: 07.734.00.00-rc1 gitlab # [ 0.430799] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff] gitlab # [ 0.436472] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.436507] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.440843] Using buffer write method gitlab # [ 0.440905] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff] gitlab # [ 0.445691] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000 gitlab # [ 0.445721] Intel/Sharp Extended Query Table at 0x0031 gitlab # [ 0.449007] Using buffer write method gitlab # [ 0.449037] Concatenating MTD devices: gitlab # [ 0.449043] (0): "0.flash" gitlab # [ 0.449049] (1): "0.flash" gitlab # [ 0.449054] into device "0.flash" gitlab # [ 0.586225] Freeing initrd memory: 27184K gitlab # [ 0.608829] tun: Universal TUN/TAP device driver, 1.6 gitlab # [ 0.619707] thunder_xcv, ver 1.0 gitlab # [ 0.619813] thunder_bgx, ver 1.0 gitlab # [ 0.619897] nicpf, ver 1.0 gitlab # [ 0.622042] e1000: Intel(R) PRO/1000 Network Driver gitlab # [ 0.622059] e1000: Copyright (c) 1999-2006 Intel Corporation. gitlab # [ 0.622138] e1000e: Intel(R) PRO/1000 Network Driver gitlab # [ 0.622154] e1000e: Copyright(c) 1999 - 2015 Intel Corporation. gitlab # [ 0.622260] igb: Intel(R) Gigabit Ethernet Network Driver gitlab # [ 0.622273] igb: Copyright (c) 2007-2014 Intel Corporation. gitlab # [ 0.622383] igbvf: Intel(R) Gigabit Virtual Function Network Driver gitlab # [ 0.622401] igbvf: Copyright (c) 2009 - 2012 Intel Corporation. gitlab # [ 0.622924] sky2: driver version 1.30 gitlab # [ 0.628950] ehci-pci 0000:00:0a.0: EHCI Host Controller gitlab # [ 0.629010] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1 gitlab # [ 0.629059] usbcore: registered new interface driver usb-storage gitlab # [ 0.629654] usbcore: registered new interface driver usbserial_generic gitlab # [ 0.629691] usbserial: USB Serial support registered for generic gitlab # [ 0.629697] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000 gitlab # [ 0.631858] hv_vmbus: registering driver hyperv_keyboard gitlab # [ 0.635119] rtc-pl031 9010000.pl031: registered as rtc0 gitlab # [ 0.635196] rtc-pl031 9010000.pl031: setting system clock to 2026-08-20T05:53:21 UTC (1787205201) gitlab # [ 0.636213] i2c_dev: i2c /dev entries driver gitlab # [ 0.639026] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00 gitlab # [ 0.640278] hub 1-0:1.0: USB hub found gitlab # [ 0.640327] hub 1-0:1.0: 6 ports detected gitlab # [ 0.645832] sdhci: Secure Digital Host Controller Interface driver gitlab # [ 0.645860] sdhci: Copyright(c) Pierre Ossman gitlab # [ 0.646780] Synopsys Designware Multimedia Card Interface Driver gitlab # [ 0.648136] sdhci-pltfm: SDHCI platform and OF driver helper gitlab # [ 0.653647] hid: raw HID events driver (C) Jiri Kosina gitlab # [ 0.654625] usbcore: registered new interface driver usbhid gitlab # [ 0.654636] usbhid: USB HID core driver gitlab # [ 0.665749] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available gitlab # [ 0.671903] drop_monitor: Initializing network drop monitor service gitlab # [ 0.672371] NET: Registered PF_INET6 protocol family gitlab # [ 0.674798] Segment Routing with IPv6 gitlab # [ 0.674846] In-situ OAM (IOAM) with IPv6 gitlab # [ 0.675252] NET: Registered PF_PACKET protocol family gitlab # [ 0.675698] 9pnet: Installing 9P2000 support gitlab # [ 0.680574] Key type dns_resolver registered gitlab # [ 0.700357] registered taskstats version 1 gitlab # [ 0.700908] Loading compiled-in X.509 certificates gitlab # [ 0.723627] Demotion targets for Node 0: null gitlab # [ 0.723855] Key type .fscrypt registered gitlab # [ 0.723862] Key type fscrypt-provisioning registered gitlab # [ 0.724099] ima: No TPM chip found, activating TPM-bypass! gitlab # [ 0.724125] ima: Allocated hash algorithm: sha1 gitlab # [ 0.724172] ima: No architecture policies found gitlab # [ 0.725386] input: gpio-keys as /devices/platform/gpio-keys/input/input0 gitlab # [ 0.763051] clk: Disabling unused clocks gitlab # [ 0.763113] PM: genpd: Disabling unused power domains gitlab # [ 0.772341] Freeing unused kernel memory: 4736K gitlab # [ 0.772672] Run /init as init process gitlab # [ 0.819259] systemd[1]: Successfully made /usr/ read-only. gitlab # [ 0.886942] usb 1-1: new high-speed USB device number 2 using ehci-pci gitlab # [ 1.039376] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1 gitlab # [ 1.131445] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0 gitlab # [ 1.154378] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 1.154452] systemd[1]: Detected virtualization qemu. gitlab # [ 1.154533] systemd[1]: Detected architecture arm64. gitlab # [ 1.154547] systemd[1]: Running in initrd. gitlab # [ 1.155580] systemd[1]: Initializing machine ID from random generator. gitlab # [ 1.155962] systemd[1]: Hostname set to . gitlab # [ 1.250984] usb 1-2: new high-speed USB device number 3 using ehci-pci gitlab # [ 1.405183] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2 gitlab # [ 1.405995] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0 gitlab # [ 1.430989] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 1.536320] systemd[1]: Queued start job for default target Initrd Default Target. gitlab # [ 1.555406] systemd[1]: Created slice Slice /system/modprobe. gitlab # [ 1.555855] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 1.555948] systemd[1]: Expecting device /dev/disk/by-label/nix-store... gitlab # [ 1.555967] systemd[1]: Expecting device /dev/disk/by-label/nixos... gitlab # [ 1.556005] systemd[1]: Reached target Path Units. gitlab # [ 1.556034] systemd[1]: Reached target Slice Units. gitlab # [ 1.556178] systemd[1]: Reached target Swaps. gitlab # [ 1.556214] systemd[1]: Reached target Timer Units. gitlab # [ 1.556477] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 1.556742] systemd[1]: Listening on Journal Socket (/dev/log). gitlab # [ 1.556949] systemd[1]: Listening on Journal Sockets. gitlab # [ 1.557149] systemd[1]: Listening on udev Control Socket. gitlab # [ 1.557389] systemd[1]: Listening on udev Kernel Socket. gitlab # [ 1.557440] systemd[1]: Reached target Socket Units. gitlab # [ 1.560268] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 1.563115] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 1.563216] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 1.565866] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 1.598472] systemd[1]: Starting Journal Service... gitlab # [ 1.603866] systemd[1]: Starting Load Kernel Modules... gitlab # [ 1.604118] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 1.610647] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 1.615810] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 1.619183] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 1.622914] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 1.626677] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 1.635188] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 1.640082] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0 gitlab # [ 1.640264] [drm] features: -virgl +edid -resource_blob -host_visible gitlab # [ 1.640278] [drm] features: -context_init gitlab # [ 1.641439] [drm] number of scanouts: 1 gitlab # [ 1.641456] [drm] number of cap sets: 0 gitlab # [ 1.648615] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log. gitlab # [ 1.649115] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev gitlab # [ 1.649450] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic gitlab # [ 1.649458] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0 gitlab # [ 1.654189] Console: switching to colour frame buffer device 160x50 gitlab # [ 1.659183] systemd-journald[95]: Collecting audit messages is disabled. gitlab # [ 1.660415] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device gitlab # [ 1.677666] systemd[1]: Finished Load Kernel Modules. gitlab # [ 1.680646] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 1.702455] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 1.707328] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 1.714237] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 1.736101] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 1.739499] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 1.743297] systemd[1]: Reached target Local File Systems. gitlab # [ 1.743431] systemd-modules-load[96]: Using 4 probe threads gitlab # [ 1.745697] systemd-modules-load[96]: Module 'virtio_balloon' is built in gitlab # [ 1.746969] systemd-modules-load[96]: Module 'virtio_console' is built in gitlab # [ 1.750350] systemd-modules-load[96]: Module 'virtio_rng' is built in gitlab # [ 1.751484] systemd-modules-load[96]: Inserted module 'dm_mod'[ 1.749892] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 1.750501] systemd[1]: Started Journal Service. gitlab # gitlab # [ 1.757387] systemd-modules-load[96]: Inserted module 'virtio_gpu' gitlab # [ 1.759273] systemd[1]: Starting Create System Files and Directories... gitlab # [ 1.802130] systemd[1]: Finished Create System Files and Directories. gitlab # [ 1.846802] systemd-udevd[108]: Using default interface naming scheme 'v261'. gitlab # [ 1.878740] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 1.924257] systemd[1]: Starting Virtual Console Setup... gitlab # [ 1.994990] systemd-vconsole-setup[130]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 2.000796] systemd[1]: Finished Virtual Console Setup. gitlab # [ 2.341293] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 2.344161] systemd[1]: Reached target System Initialization. gitlab # [ 2.346832] systemd[1]: Reached target Basic System. gitlab # [ 2.625757] (udev-worker)[146]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 2.630717] (udev-worker)[146]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.639434] (udev-worker)[123]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 2.671895] systemd[1]: Found device /dev/disk/by-label/nixos. gitlab # [ 2.684095] systemd[1]: Found device /dev/disk/by-label/nix-store. gitlab # [ 2.693565] systemd[1]: Reached target Initrd Root Device. gitlab # [ 2.694993] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos... gitlab # [ 2.742077] systemd-fsck[152]: nixos: clean, 12/65536 files, 13019/262144 blocks gitlab # [ 2.752185] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos. gitlab # [ 2.754247] systemd[1]: Mounting /sysroot... gitlab # [ 2.801229] EXT4-fs (vda): mounted filesystem 2b4a6797-199c-4c53-8784-9f07d5d332e7 r/w with ordered data mode. Quota mode: none. gitlab # [ 2.801835] systemd[1]: Mounted /sysroot. gitlab # [ 2.802737] systemd[1]: Reached target Initrd Root File System. gitlab # [ 2.803935] systemd[1]: Starting Mountpoints Configured in the Real Root... gitlab # [ 2.843093] systemd-sysroot-fstab-check[160]: /sysroot should be mounted in the initrd, will request daemon-reload. gitlab # [ 2.846765] systemd[1]: Reload requested from client PID 160 ('systemd-sysroot') (unit initrd-parse-etc.service)... gitlab # [ 2.849415] systemd[1]: Reloading... gitlab # [ 2.961344] systemd[1]: Reloading finished in 115 ms. gitlab # [ 3.014115] systemd-sysroot-fstab-check[160]: Requesting initrd-fs.target/start/replace... gitlab # [ 3.016433] systemd-sysroot-fstab-check[160]: Requesting swap.target/start/replace... gitlab # [ 3.020611] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 3.023091] systemd[1]: initrd-parse-etc.service: Deactivated successfully. gitlab # [ 3.025219] systemd[1]: Finished Mountpoints Configured in the Real Root. gitlab # [ 3.026734] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies. gitlab # [ 3.055871] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 3.057405] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 3.245068] (udev-worker)[125]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory gitlab # [ 3.248299] (udev-worker)[125]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory gitlab # [ 3.253707] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 3.255313] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 3.256193] systemd[1]: Stopping Virtual Console Setup... gitlab # [ 3.256984] systemd[1]: Starting Virtual Console Setup... gitlab # [ 3.291500] systemd-vconsole-setup[182]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 3.293625] systemd[1]: Finished Virtual Console Setup. gitlab # [ 3.619981] systemd[1]: Mounting /sysroot/nix/.ro-store... gitlab # [ 3.624218] systemd[1]: Mounting /sysroot/nix/.rw-store... gitlab # [ 3.631191] systemd[1]: Mounting /sysroot/run... gitlab # [ 3.657190] systemd[1]: Mounting /sysroot/tmp/shared... gitlab # [ 3.668412] systemd[1]: Mounting /sysroot/tmp/xchg... gitlab # [ 3.677270] systemd[1]: Mounted /sysroot/nix/.rw-store. gitlab # [ 3.694388] erofs (device vdb): mounted with root inode @ nid 128. gitlab # [ 3.693699] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 3.705677] systemd[1]: Mounted /sysroot/nix/.ro-store. gitlab # [ 3.711775] systemd[1]: Mounted /sysroot/run. gitlab # [ 3.714201] systemd[1]: Mounted /sysroot/tmp/shared. gitlab # [ 3.716566] systemd[1]: Mounted /sysroot/tmp/xchg. gitlab # [ 3.750778] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 3.754262] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 3.758478] systemd[1]: Mounting /sysroot/nix/store... gitlab # [ 3.844408] systemd[1]: Mounted /sysroot/nix/store. gitlab # [ 3.846901] systemd[1]: Reached target Initrd File Systems. gitlab # [ 3.849635] systemd[1]: Starting Find NixOS closure... gitlab # [ 3.853997] systemd[1]: Starting Create Volatile Files and Directories in the Real Root... gitlab # [ 3.914176] systemd[1]: Finished Create Volatile Files and Directories in the Real Root. gitlab # [ 3.941987] systemd[1]: Finished Find NixOS closure. gitlab # [ 3.944582] systemd[1]: Reached target Initrd Default Target. gitlab # [ 3.948388] systemd[1]: Starting Cleaning Up and Shutting Down Daemons... gitlab # [ 4.014857] systemd[1]: Stopped target Initrd Default Target. gitlab # [ 4.017849] systemd[1]: Stopped target Basic System. gitlab # [ 4.020267] systemd[1]: Stopped target Initrd Root Device. gitlab # [ 4.022873] systemd[1]: Stopped target Path Units. gitlab # [ 4.025259] systemd[1]: systemd-ask-password-console.path: Deactivated successfully. gitlab # [ 4.028689] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch. gitlab # [ 4.032158] systemd[1]: Stopped target Slice Units. gitlab # [ 4.034481] systemd[1]: Stopped target Socket Units. gitlab # [ 4.036975] systemd[1]: Stopped target System Initialization. gitlab # [ 4.039598] systemd[1]: Stopped target Swaps. gitlab # [ 4.041853] systemd[1]: Stopped target Timer Units. gitlab # [ 4.044218] systemd[1]: dbus.socket: Deactivated successfully. gitlab # [ 4.050785] systemd[1]: Closed D-Bus System Message Bus Socket. gitlab # [ 4.054047] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully. gitlab # [ 4.060737] systemd[1]: Stopped Find NixOS closure. gitlab # [ 4.063454] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 4.067155] systemd[1]: Starting rw-sysroot-nix-store.service... gitlab # [ 4.069953] systemd[1]: systemd-sysctl.service: Deactivated successfully. gitlab # [ 4.072764] systemd[1]: Stopped Apply Kernel Variables. gitlab # [ 4.074926] systemd[1]: systemd-modules-load.service: Deactivated successfully. gitlab # [ 4.077882] systemd[1]: Stopped Load Kernel Modules. gitlab # [ 4.079757] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully. gitlab # [ 4.082590] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root. gitlab # [ 4.085469] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully. gitlab # [ 4.087638] systemd[1]: Stopped Create System Files and Directories. gitlab # [ 4.089837] systemd[1]: Stopped target Local File Systems. gitlab # [ 4.091486] systemd[1]: Stopped target Preparation for Local File Systems. gitlab # [ 4.093748] systemd[1]: systemd-udev-trigger.service: Deactivated successfully. gitlab # [ 4.095936] systemd[1]: Stopped Coldplug All udev Devices. gitlab # [ 4.098837] systemd[1]: Stopping Rule-based Manager for Device Events and Files... gitlab # [ 4.101231] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully. gitlab # [ 4.103547] systemd[1]: Stopped Virtual Console Setup. gitlab # [ 4.105227] systemd[1]: initrd-cleanup.service: Deactivated successfully. gitlab # [ 4.107212] systemd[1]: Finished Cleaning Up and Shutting Down Daemons. gitlab # [ 4.109219] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully. gitlab # [ 4.111294] systemd[1]: Finished rw-sysroot-nix-store.service. gitlab # [ 4.113150] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 4.115303] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 4.117179] systemd[1]: systemd-udevd.service: Deactivated successfully. gitlab # [ 4.119181] systemd[1]: Stopped Rule-based Manager for Device Events and Files. gitlab # [ 4.121412] systemd[1]: systemd-udevd.service: Consumed 2.681s CPU time over 2.351s wall clock time, 31.5M memory peak. gitlab # [ 4.124255] systemd[1]: systemd-udevd-control.socket: Deactivated successfully. gitlab # [ 4.126215] systemd[1]: Closed udev Control Socket. gitlab # [ 4.127519] systemd[1]: Starting Cleanup udev Database... gitlab # [ 4.129039] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully. gitlab # [ 4.130981] systemd[1]: Stopped Create Static Device Nodes in /dev. gitlab # [ 4.132589] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully. gitlab # [ 4.134566] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully. gitlab # [ 4.136476] systemd[1]: kmod-static-nodes.service: Deactivated successfully. gitlab # [ 4.138115] systemd[1]: Stopped Create List of Static Device Nodes. gitlab # [ 4.219310] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully. gitlab # [ 4.223044] systemd[1]: Finished Cleanup udev Database. gitlab # [ 4.225614] systemd[1]: Reached target Switch Root. gitlab # [ 4.227958] systemd[1]: Starting NixOS Activation... gitlab # [ 4.456291] initrd-nixos-activation-start[221]: booting system configuration /nix/store/cvhdmd78nk8ap6q3mi6qhlfw2rq7knjk-nixos-system-gitlab-test gitlab # [ 4.536451] initrd-nixos-activation-start[221]: running activation script... gitlab # [ 4.958415] initrd-nixos-activation-start[244]: setting up /etc... gitlab # [ 5.128271] systemd[1]: initrd-nixos-activation.service: Deactivated successfully. gitlab # [ 5.131630] systemd[1]: Finished NixOS Activation. gitlab # [ 5.134027] systemd[1]: Starting Switch Root... gitlab # [ 5.183703] systemd[1]: Switching root. gitlab # [ 5.292075] systemd-journald[95]: Received SIGTERM from PID 1 (systemd). gitlab # [ 5.964722] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) gitlab # [ 5.964867] systemd[1]: Detected virtualization qemu. gitlab # [ 5.964966] systemd[1]: Detected architecture arm64. gitlab # [ 5.965150] systemd[1]: Detected first boot. gitlab # [ 5.966549] systemd[1]: Initializing machine ID from random generator. gitlab # [ 6.233582] systemd[1]: bpf-restrict-fs: LSM BPF program attached gitlab # [ 6.358827] systemd[1]: Applying preset policy. gitlab # [ 6.568952] systemd[1]: Populated /etc with preset unit settings. gitlab # [ 6.715206] systemd[1]: initrd-switch-root.service: Deactivated successfully. gitlab # [ 6.716080] systemd[1]: Stopped initrd-switch-root.service. gitlab # [ 6.718734] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. gitlab # [ 6.727262] systemd[1]: Created slice Slice /system/getty. gitlab # [ 6.730724] systemd[1]: Created slice GitLab DevOps Platform Slice. gitlab # [ 6.735186] systemd[1]: Created slice User and Session Slice. gitlab # [ 6.736727] systemd[1]: Started Dispatch Password Requests to Console Directory Watch. gitlab # [ 6.738134] systemd[1]: Started Forward Password Requests to Wall Directory Watch. gitlab # [ 6.739444] systemd[1]: Expecting device /dev/hvc0... gitlab # [ 6.740552] systemd[1]: Expecting device /dev/ttyAMA0... gitlab # [ 6.741705] systemd[1]: Reached target Local Encrypted Volumes. gitlab # [ 6.742888] systemd[1]: Stopped target initrd-fs.target. gitlab # [ 6.743990] systemd[1]: Stopped target initrd-root-fs.target. gitlab # [ 6.745112] systemd[1]: Stopped target initrd-switch-root.target. gitlab # [ 6.746260] systemd[1]: Reached target Virtual Machines and Containers. gitlab # [ 6.747451] systemd[1]: Reached target Path Units. gitlab # [ 6.748574] systemd[1]: Reached target Remote File Systems. gitlab # [ 6.749713] systemd[1]: Reached target Slice Units. gitlab # [ 6.750843] systemd[1]: Reached target Swaps. gitlab # [ 6.755104] systemd[1]: Listening on Query the User Interactively for a Password. gitlab # [ 6.759583] systemd[1]: Listening on Process Core Dump Socket. gitlab # [ 6.762722] systemd[1]: Listening on Credential Encryption/Decryption. gitlab # [ 6.767166] systemd[1]: Listening on Factory Reset Management. gitlab # [ 6.768374] systemd[1]: Listening on Hostname Service Socket. gitlab # [ 6.778328] systemd[1]: Starting Journal Log Access Socket... gitlab # [ 6.780538] systemd[1]: Listening on Journal Audit Socket. gitlab # [ 6.784717] systemd[1]: Listening on Console Output Muting Service Socket. gitlab # [ 6.786275] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket. gitlab # [ 6.787475] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.788468] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki gitlab # [ 6.794579] systemd[1]: Listening on Disk Repartitioning Service Socket. gitlab # [ 6.795944] systemd[1]: Listening on udev Control Socket. gitlab # [ 6.797367] systemd[1]: Listening on udev Varlink Socket. gitlab # [ 6.832123] systemd[1]: Mounting Huge Pages File System... gitlab # [ 6.837876] systemd[1]: Mounting POSIX Message Queue File System... gitlab # [ 6.844747] systemd[1]: Mounting Kernel Debug File System... gitlab # [ 6.853012] systemd[1]: Mounting Kernel Trace File System... gitlab # [ 6.862021] systemd[1]: Starting Create List of Static Device Nodes... gitlab # [ 6.869760] systemd[1]: Starting Load Kernel Module 9pnet_virtio... gitlab # [ 6.871091] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 6.885705] systemd[1]: Mounting Kernel Configuration File System... gitlab # [ 6.887141] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm gitlab # [ 6.890599] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 6.903589] systemd[1]: Starting Load Kernel Module fuse... gitlab # [ 6.905984] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 6.916747] systemd[1]: Starting Journal Service... gitlab # [ 6.925574] systemd[1]: Starting Load Kernel Modules... gitlab # [ 6.931167] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer... gitlab # [ 6.940755] systemd[1]: Starting Remount Root and Kernel File Systems... gitlab # [ 6.941378] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 6.956544] systemd-journald[315]: Collecting audit messages is enabled. gitlab # [ 6.957901] systemd[1]: Starting Coldplug All udev Devices... gitlab # [ 6.962522] systemd[1]: Listening on Journal Log Access Socket. gitlab # [ 6.963388] systemd[1]: Mounted Huge Pages File System. gitlab # [ 6.964333] systemd[1]: Mounted POSIX Message Queue File System. gitlab # [ 6.965246] systemd[1]: Mounted Kernel Debug File System. gitlab # [ 6.966126] systemd[1]: Mounted Kernel Trace File System. gitlab # [ 6.967459] systemd[1]: Finished Create List of Static Device Nodes. gitlab # [ 6.968695] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully. gitlab # [ 6.969601] systemd[1]: Finished Load Kernel Module 9pnet_virtio. gitlab # [ 6.985305] systemd[1]: Queued start job for default target Multi-User System. gitlab # [ 6.970419] systemd[1]: Mounted Kernel Configuration File System. gitlab # [ 6.979233] systemd[1]: Starting Create Static Device Nodes in /dev gracefully... gitlab # [ 6.993906] fuse: init (API version 7.45) gitlab # [ 6.996998] systemd[1]: Started Journal Service. gitlab # [ 6.990971] systemd[1]: Unnecessary job was removed for /dev/vdb. gitlab # [ 6.999012] systemd[1]: systemd-journald.service: Deactivated successfully. gitlab # [ 7.000574] systemd-modules-load[316]: Using 3 probe threads gitlab # [ 7.001920] systemd-modules-load[316]: Module 'atkbd' is built in gitlab # [ 7.002964] systemd-modules-load[316]: Module 'loop' is built in gitlab # [ 7.004088] systemd-modules-load[316]: Inserted module 'tls' gitlab # [ 7.005087] systemd[1]: modprobe@fuse.service: Deactivated successfully. gitlab # [ 7.007721] systemd[1]: Finished Load Kernel Module fuse. gitlab # [ 7.008840] systemd[1]: Finished Load Kernel Modules. gitlab # [ 7.012855] systemd[1]: Mounting FUSE Control File System... gitlab # [ 7.018943] EXT4-fs (vda): re-mounted 2b4a6797-199c-4c53-8784-9f07d5d332e7. gitlab # [ 7.018940] systemd[1]: Starting Firewall... gitlab # [ 7.040299] systemd[1]: Starting Apply Kernel Variables... gitlab # [ 7.043267] systemd-oomd[318]: No swap; memory pressure usage will be degraded gitlab # [ 7.044958] systemd[1]: Finished Remount Root and Kernel File Systems. gitlab # [ 7.045997] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer. gitlab # [ 7.046926] systemd[1]: Finished Create Static Device Nodes in /dev gracefully. gitlab # [ 7.048489] systemd[1]: Mounted FUSE Control File System. gitlab # [ 7.050366] systemd[1]: Listening on Disk Image Download Service Socket. gitlab # [ 7.052443] systemd[1]: Starting Flush Journal to Persistent Storage... gitlab # [ 7.053731] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 7.057794] systemd[1]: Starting Load/Save OS Random Seed... gitlab # [ 7.064112] systemd[1]: Starting Create Static Device Nodes in /dev... gitlab # [ 7.065203] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.076397] systemd-journald[315]: Received client request to flush runtime journal. gitlab # [ 7.106729] systemd[1]: Finished Apply Kernel Variables. gitlab # [ 7.108367] systemd[1]: Finished Load/Save OS Random Seed. gitlab # [ 7.109381] systemd[1]: Reached target First Boot Complete. gitlab # [ 7.110877] systemd[1]: Finished Create Static Device Nodes in /dev. gitlab # [ 7.112186] systemd[1]: Reached target Preparation for Local File Systems. gitlab # [ 7.113182] systemd[1]: Starting Rule-based Manager for Device Events and Files... gitlab # [ 7.114335] systemd[1]: Finished Flush Journal to Persistent Storage. gitlab # [ 7.202698] systemd-udevd[350]: Using default interface naming scheme 'v261'. gitlab # [ 7.269890] systemd[1]: Started Rule-based Manager for Device Events and Files. gitlab # [ 7.489870] systemd[1]: Finished Firewall. gitlab # [ 7.602784] systemd[1]: Finished Coldplug All udev Devices. gitlab # [ 7.690108] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs gitlab # [ 7.740307] systemd[1]: Mounting /run/wrappers... gitlab # [ 7.750169] systemd[1]: Condition check resulted in /dev/hvc0 being skipped. gitlab # [ 7.777806] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped. gitlab # [ 7.796548] systemd[1]: Mounted /run/wrappers. gitlab # [ 7.799488] systemd[1]: Reached target Local File Systems. gitlab # [ 7.801799] systemd[1]: Listening on Boot Loader Control Service Socket. gitlab # [ 7.805931] systemd[1]: Starting register-nix-paths.service... gitlab # [ 7.816306] (udev-worker)[469]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.824231] systemd[1]: Starting Create SUID/SGID Wrappers... gitlab # [ 7.825678] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.827782] (udev-worker)[472]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name. gitlab # [ 7.832132] (udev-worker)[472]: Network interface NamePolicy= disabled on kernel command line. gitlab # [ 7.843781] systemd[1]: Starting Save Transient machine-id to Disk... gitlab # [ 7.859816] systemd[1]: Starting Create System Files and Directories... gitlab # [ 7.870724] systemd[1]: Condition check resulted in Virtio network device being skipped. gitlab # [ 7.872653] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore gitlab # [ 7.874201] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met. gitlab # [ 7.875478] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67 gitlab # [ 7.878385] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore gitlab # [ 7.880339] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.881853] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os gitlab # [ 7.909282] systemd[1]: Finished Create System Files and Directories. gitlab # [ 7.911073] systemd[1]: etc-machine\x2did.mount: Deactivated successfully. gitlab # [ 7.913131] systemd[1]: Finished Save Transient machine-id to Disk. gitlab # [ 7.916534] systemd[1]: Starting Rebuild Journal Catalog... gitlab # [ 7.920332] systemd[1]: Starting Record System Boot/Shutdown in UTMP... gitlab # [ 7.967648] systemd[1]: Finished Record System Boot/Shutdown in UTMP. gitlab # [ 7.976767] mousedev: PS/2 mouse device common for all mice gitlab # [ 7.984800] systemd[1]: Finished Rebuild Journal Catalog. gitlab # [ 7.987701] systemd[1]: Starting Update is Completed... gitlab # [ 8.020681] systemd[1]: Finished Update is Completed. gitlab # [ 8.050828] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully. gitlab # [ 8.052318] systemd[1]: Finished Create SUID/SGID Wrappers. gitlab # [ 8.053191] systemd[1]: suid-sgid-wrappers.service: Consumed 143ms CPU time over 229ms wall clock time, 6.4M memory peak, 1.9M read from disk. gitlab # [ 8.343008] systemd[1]: Finished register-nix-paths.service. gitlab # [ 8.344131] systemd[1]: Reached target System Initialization. gitlab # [ 8.345051] systemd[1]: Started Discard unused filesystem blocks once a week. gitlab # [ 8.346909] systemd[1]: Started logrotate.timer. gitlab # [ 8.348293] systemd[1]: Started Daily Cleanup of Temporary Directories. gitlab # [ 8.350842] systemd[1]: Reached target Timer Units. gitlab # [ 8.351681] systemd[1]: Listening on D-Bus System Message Bus Socket. gitlab # [ 8.352816] systemd[1]: Listening on Nix Daemon Socket. gitlab # [ 8.360953] systemd[1]: Starting nixbot CI service socket... gitlab # [ 8.362012] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. gitlab # [ 8.366628] systemd[1]: Starting D-Bus System Message Bus... gitlab # [ 8.367628] systemd[1]: Listening on nixbot CI service socket. gitlab # [ 8.368611] systemd[1]: Reached target Socket Units. gitlab # [ 8.423502] dbus-broker-launch[563]: Looking up NSS user entry for 'systemd-timesync'... gitlab # [ 8.426107] dbus-broker-launch[563]: NSS returned no entry for 'systemd-timesync' gitlab # [ 8.427464] dbus-broker-launch[563]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" gitlab # [ 8.430878] systemd[1]: Started D-Bus System Message Bus. gitlab # [ 8.440767] dbus-broker-launch[563]: Ready gitlab # [ 8.441943] systemd[1]: Reached target Basic System. gitlab # [ 8.464038] systemd[1]: Started backdoor.service. gitlab # [ 8.482881] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3 gitlab # [ 8.493317] systemd[1]: Starting gitlab-config.service... gitlab # connecting to host... gitlab # [ 8.515201] systemd[1]: Starting Import lastlog data into lastlog2 database... gitlab # [ 8.516919] systemd[1]: Starting Logrotate configuration check... gitlab: Guest shell says: b'Spawning backdoor root shell...\n' gitlab # [ 8.521591] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 8.526326] systemd[1]: Starting Post-Boot Actions... gitlab # [ 8.532147] logrotate[575]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want. gitlab: connected to guest root shell gitlab # [ 8.536062] logrotate[575]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf gitlab: (connecting took 8.98 seconds) gitlab # [ 8.537326] logrotate[575]: note: 'monthly' overrides previously specified 'weekly' gitlab: (finished: waiting for the VM to finish booting, in 8.99 seconds) gitlab # [ 8.538504] logrotate[575]: Reading state from file: /var/lib/logrotate.status gitlab # [ 8.539478] logrotate[575]: state file /var/lib/logrotate.status does not exist gitlab # [ 8.541243] logrotate[575]: Allocating hash table for state file, size 64 entries gitlab # [ 8.542285] logrotate[575]: Handling 4 logs gitlab # [ 8.542943] logrotate[575]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 8.545703] logrotate[575]: considering log /var/log/btmp gitlab # [ 8.549306] logrotate[575]: Creating new state gitlab # [ 8.550064] logrotate[575]: Now: 2026-08-20 05:53 gitlab # [ 8.550728] logrotate[575]: Last rotated at 2026-08-20 05:00 gitlab # [ 8.551494] logrotate[575]: log does not need rotating (log has already been rotated) gitlab # [ 8.553129] logrotate[575]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed gitlab # [ 8.555453] logrotate[575]: considering log /var/log/wtmp gitlab # [ 8.557991] logrotate[575]: Creating new state gitlab # [ 8.558712] logrotate[575]: Now: 2026-08-20 05:53 gitlab # [ 8.559374] logrotate[575]: Last rotated at 2026-08-20 05:00 gitlab # [ 8.562475] logrotate[575]: log does not need rotating (log has already been rotated) gitlab # [ 8.563674] logrotate[575]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed gitlab # [ 8.565786] logrotate[575]: switching euid from 0 to 165 and egid from 0 to 165 (pid 575) gitlab # [ 8.566926] logrotate[575]: considering log /var/gitlab/state/log/*.log gitlab # [ 8.567851] logrotate[575]: log /var/gitlab/state/log/*.log does not exist -- skipping gitlab # [ 8.569076] logrotate[575]: Creating new state gitlab # [ 8.569684] logrotate[575]: switching euid from 165 to 0 and egid from 165 to 0 (pid 575) gitlab # [ 8.570762] logrotate[575]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed gitlab # [ 8.572640] logrotate[575]: switching euid from 0 to 60 and egid from 0 to 60 (pid 575) gitlab # [ 8.573667] logrotate[575]: considering log /var/log/nginx/*.log gitlab # [ 8.574461] logrotate[575]: log /var/log/nginx/*.log does not exist -- skipping gitlab # [ 8.575470] logrotate[575]: Creating new state gitlab # [ 8.576083] logrotate[575]: not running postrotate script, since no logs were rotated gitlab # [ 8.577087] logrotate[575]: switching euid from 60 to 0 and egid from 60 to 0 (pid 575) gitlab # [ 8.578503] nsncd[576]: Aug 20 05:53:29.433 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.580691] systemd[1]: Started Reset console on configuration changes. gitlab # [ 8.581753] systemd[1]: Starting resolvconf update... gitlab # [ 8.582628] systemd[1]: Finished Logrotate configuration check. gitlab # [ 8.583576] systemd[1]: Finished Post-Boot Actions. gitlab # [ 8.584387] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.585272] systemd[1]: Finished Import lastlog data into lastlog2 database. gitlab # [ 8.598365] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.599668] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.603762] systemd[1]: Starting User Login Management... gitlab # [ 8.605626] systemd[1]: Starting Virtual Console Setup... gitlab # [ 8.628493] systemd[1]: Stopped target Host and Network Name Lookups. gitlab # [ 8.629789] systemd[1]: Stopping Host and Network Name Lookups... gitlab # [ 8.630665] systemd[1]: Stopped target User and Group Name Lookups. gitlab # [ 8.631630] systemd[1]: Stopping User and Group Name Lookups... gitlab # [ 8.632540] systemd[1]: Stopping Name Service Cache Daemon (nsncd)... gitlab # [ 8.634207] systemd[1]: nscd.service: Deactivated successfully. gitlab # [ 8.635085] systemd[1]: Stopped Name Service Cache Daemon (nsncd). gitlab # [ 8.635972] systemd[1]: nscd.service: Consumed 24ms CPU time over 112ms wall clock time, 7.6M memory peak, 5.8M read from disk. gitlab # [ 8.644189] systemd[1]: Starting Name Service Cache Daemon (nsncd)... gitlab # [ 8.660581] nsncd[661]: Aug 20 05:53:29.527 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" gitlab # [ 8.662944] systemd[1]: Started Name Service Cache Daemon (nsncd). gitlab # [ 8.664857] systemd[1]: Reached target Host and Network Name Lookups. gitlab # [ 8.666203] systemd[1]: Reached target User and Group Name Lookups. gitlab # [ 8.673957] systemd[1]: Finished resolvconf update. gitlab # [ 8.675126] systemd[1]: Reached target Preparation for Network. gitlab # [ 8.677967] systemd[1]: Starting DHCP Client... gitlab # [ 8.685649] systemd[1]: Starting Address configuration of eth1... gitlab # [ 8.687040] systemd-logind[633]: New seat seat0. gitlab # [ 8.688474] systemd[1]: Starting Extra networking commands.... gitlab # [ 8.689329] systemd-logind[633]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard) gitlab # [ 8.690546] systemd-logind[633]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard) gitlab # [ 8.691758] systemd-logind[633]: Watching system buttons on /dev/input/event0 (gpio-keys) gitlab # [ 8.692919] systemd[1]: Started User Login Management. gitlab # [ 8.699964] systemd-vconsole-setup[635]: Configuration of first virtual console was skipped, ignoring remaining ones. gitlab # [ 8.707621] systemd[1]: Starting linger-users.service... gitlab # [ 8.710074] systemd[1]: Finished Virtual Console Setup. gitlab # [ 8.728519] systemd[1]: linger-users.service: Deactivated successfully. gitlab # [ 8.730244] systemd[1]: Finished linger-users.service. gitlab # [ 8.740685] network-addresses-eth1-start[689]: adding address 192.168.1.1/24... done gitlab # [ 8.744998] network-addresses-eth1-start[689]: adding address 2001:db8:1::1/64... done gitlab # [ 8.752780] systemd[1]: Finished Address configuration of eth1. gitlab # [ 8.789090] systemd[1]: Finished Extra networking commands.. gitlab # [ 8.790109] systemd[1]: Reached target Network. gitlab # [ 8.792907] systemd[1]: Starting gitlab-workhorse.service... gitlab # [ 8.796433] systemd[1]: Starting Nginx Web Server... gitlab # [ 8.800138] systemd[1]: Starting PostgreSQL Server... gitlab # [ 8.805929] systemd[1]: Starting Redis Server - redis-gitlab... gitlab # [ 8.809255] dhcpcd[717]: dhcpcd-10.3.2 starting gitlab # [ 8.812446] systemd[1]: Starting Permit User Sessions... gitlab # [ 8.814496] dhcpcd[763]: dev: loaded udev gitlab # [ 8.829191] 8021q: 802.1Q VLAN Support v1.8 gitlab # [ 8.829635] 8021q: adding VLAN 0 to HW filter on device eth1 gitlab # [ 8.842833] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch. gitlab # [ 8.856156] systemd[1]: Finished Permit User Sessions. gitlab # [ 8.865570] systemd[1]: Started Getty on tty1. gitlab # [ 8.866717] systemd[1]: Reached target Login Prompts. gitlab # [ 8.880550] cfg80211: Loading compiled-in X.509 certificates for regulatory database gitlab # [ 8.891273] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7' gitlab # [ 8.891760] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600' gitlab # [ 8.895337] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2 gitlab # [ 8.895683] cfg80211: failed to load regulatory.db gitlab # [ 8.936351] 8021q: adding VLAN 0 to HW filter on device eth0 gitlab # [ 8.935350] dhcpcd[763]: eth0: waiting for carrier gitlab # [ 8.938161] dhcpcd[763]: eth0: carrier acquired gitlab # [ 8.941023] dhcpcd[763]: DUID 00:01:00:01:32:19:52:d9:52:54:00:12:34:56 gitlab # [ 8.942092] dhcpcd[763]: eth0: IAID 00:12:34:56 gitlab # [ 8.942818] dhcpcd[763]: eth0: adding address fe80::5054:ff:fe12:3456 gitlab # [ 8.993865] nginx-pre-start[789]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok gitlab # [ 8.997959] nginx-pre-start[789]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful gitlab # [ 9.005147] systemd[1]: Started Nginx Web Server. gitlab # [ 9.006407] redis-server[784]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit. gitlab # [ 9.008651] redis-server[784]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo gitlab # [ 9.009811] redis-server[784]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=784, just started gitlab # [ 9.011281] redis-server[784]: Configuration loaded gitlab # [ 9.012269] systemd[1]: Started Redis Server - redis-gitlab. gitlab # [ 9.013149] redis[784]: monotonic clock: ARM CNTVCT @ 1000 ticks/us gitlab # [ 9.014265] redis[784]: Running mode=standalone, port=0. gitlab # [ 9.015314] redis[784]: Server initialized gitlab # [ 9.016253] redis[784]: Ready to accept connections unix gitlab # [ 9.017211] redis[784]: WARNING: Redis does not require authentication. Redis will accept connections from any local client. gitlab # [ 9.024520] postgresql-pre-start[791]: The files belonging to this database system will be owned by user "postgres". gitlab # [ 9.026461] postgresql-pre-start[791]: This user must also own the server process. gitlab # [ 9.028107] postgresql-pre-start[791]: The database cluster will be initialized with locale "en_US.UTF-8". gitlab # [ 9.029386] postgresql-pre-start[791]: The default database encoding has accordingly been set to "UTF8". gitlab # [ 9.030695] postgresql-pre-start[791]: The default text search configuration will be set to "english". gitlab # [ 9.032095] postgresql-pre-start[791]: Data page checksums are enabled. gitlab # [ 9.033268] postgresql-pre-start[791]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok gitlab # [ 9.034794] postgresql-pre-start[791]: creating subdirectories ... ok gitlab # [ 9.035766] postgresql-pre-start[791]: selecting dynamic shared memory implementation ... posix gitlab # [ 9.073511] postgresql-pre-start[791]: selecting default "max_connections" ... 100 gitlab # [ 9.135292] postgresql-pre-start[791]: selecting default "shared_buffers" ... 128MB gitlab # [ 9.484223] systemd[1]: Started gitlab-workhorse.service. gitlab # [ 9.597364] postgresql-pre-start[791]: selecting default time zone ... UTC gitlab # [ 9.599634] postgresql-pre-start[791]: creating configuration files ... ok gitlab # [ 9.845067] gitlab-workhorse[819]: time="2026-08-20T05:53:30Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4 gitlab # [ 9.848888] gitlab-workhorse[819]: time="2026-08-20T05:53:30Z" level=info msg="Using redis/go-redis" gitlab # [ 9.851521] gitlab-workhorse[819]: time="2026-08-20T05:53:30Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix gitlab # [ 9.863645] postgresql-pre-start[791]: running bootstrap script ... ok gitlab # [ 9.943111] dhcpcd[763]: eth0: soliciting a DHCP lease gitlab # [ 9.952958] dhcpcd[763]: eth0: offered 10.0.2.15 from 10.0.2.2 gitlab # [ 9.972532] dhcpcd[763]: eth0: probing address 10.0.2.15/24 gitlab # [ 10.568104] postgresql-pre-start[791]: performing post-bootstrap initialization ... ok gitlab # [ 10.904091] postgresql-pre-start[791]: syncing data to disk ... ok gitlab # [ 10.906960] postgresql-pre-start[791]: initdb: warning: enabling "trust" authentication for local connections gitlab # [ 10.911382] postgresql-pre-start[791]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. gitlab # [ 10.918421] postgresql-pre-start[791]: Success. You can now start the database server using: gitlab # [ 10.922191] postgresql-pre-start[791]: pg_ctl -D /var/lib/postgresql/18 -l logfile start gitlab # [ 11.035830] postgres[853]: [853] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit gitlab # [ 11.042185] postgres[853]: [853] LOG: listening on IPv6 address "::1", port 5432 gitlab # [ 11.045810] postgres[853]: [853] LOG: listening on IPv4 address "127.0.0.1", port 5432 gitlab # [ 11.050463] postgres[853]: [853] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" gitlab # [ 11.055947] postgres[862]: [862] LOG: database system was shut down at 2026-08-20 05:53:31 GMT gitlab # [ 11.062154] postgres[853]: [853] LOG: database system is ready to accept connections gitlab # [ 11.065966] systemd[1]: Started PostgreSQL Server. gitlab # [ 11.071878] systemd[1]: Starting PostgreSQL Setup Scripts... gitlab # [ 11.288118] dhcpcd[763]: eth0: soliciting an IPv6 router gitlab # [ 11.290769] dhcpcd[763]: eth0: Router Advertisement from fe80::2 gitlab # [ 11.293840] dhcpcd[763]: eth0: adding address fec0::5054:ff:fe12:3456/64 gitlab # [ 11.296862] dhcpcd[763]: eth0: adding route to fec0::/64 gitlab # [ 11.299170] dhcpcd[763]: eth0: adding default route via fe80::2 gitlab # [ 11.482525] postgresql-setup-start[873]: CREATE DATABASE gitlab # [ 11.525154] postgresql-setup-start[883]: CREATE ROLE gitlab # [ 11.541054] postgresql-setup-start[885]: ALTER DATABASE gitlab # [ 11.583686] postgresql-setup-start[890]: CREATE ROLE gitlab # [ 11.586757] systemd[1]: Finished PostgreSQL Setup Scripts. gitlab # [ 11.590097] systemd[1]: Reached target PostgreSQL. gitlab # [ 11.592210] systemd[1]: Starting gitlab-postgresql.service... gitlab # [ 11.614669] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[878]: mkdir -p /var/gitlab/state/home/.ssh: OK gitlab # [ 11.618918] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[878]: chmod 700 /var/gitlab/state/home/.ssh: OK gitlab # [ 11.728469] systemd[1]: Finished gitlab-config.service. gitlab # [ 11.736255] systemd[1]: Started gitaly.service. gitlab # [ 11.744198] systemd[1]: Starting gitlab-db-config.service... gitlab # [ 11.784695] gitlab-postgresql-start[905]: CREATE DATABASE gitlab # [ 11.875248] gitlab-postgresql-start[927]: CREATE EXTENSION gitlab # [ 12.015901] gitlab-postgresql-start[930]: CREATE EXTENSION gitlab # [ 12.019959] systemd[1]: Finished gitlab-postgresql.service. gitlab # [ 12.663661] gitaly[912]: time="2026-08-20T05:53:33.530Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=912 gitlab # [ 12.664136] gitaly[912]: time="2026-08-20T05:53:33.530Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=912 gitlab # [ 12.664259] gitaly[912]: time="2026-08-20T05:53:33.530Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=912 gitlab # [ 12.664360] gitaly[912]: time="2026-08-20T05:53:33.530Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=912 gitlab # [ 12.664461] gitaly[912]: time="2026-08-20T05:53:33.530Z" level=info msg="Starting Gitaly" pid=912 version= gitlab # [ 12.918817] gitaly[912]: time="2026-08-20T05:53:33.786Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=255 pid=912 gitlab # [ 12.921379] gitaly[912]: time="2026-08-20T05:53:33.787Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=912 gitlab # [ 12.924678] gitaly[912]: time="2026-08-20T05:53:33.788Z" level=info msg="finished initializing command factory" duration_ms=0 pid=912 gitlab # [ 12.926974] gitaly[912]: time="2026-08-20T05:53:33.788Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-912/git-exec-4138532833.d/git pid=912 gitlab # [ 12.929824] gitaly[912]: time="2026-08-20T05:53:33.792Z" level=info msg="finished detecting git version" duration_ms=4 pid=912 gitlab # [ 12.932114] gitaly[912]: time="2026-08-20T05:53:33.792Z" level=info msg="using Git version" pid=912 version=2.53.g gitlab # [ 12.940136] gitaly[912]: time="2026-08-20T05:53:33.793Z" level=info msg="clearing disk cache object folder" pid=912 storage=default gitlab # [ 12.942361] gitaly[912]: time="2026-08-20T05:53:33.793Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache749617667 pid=912 storage=default gitlab # [ 12.945658] gitaly[912]: time="2026-08-20T05:53:33.793Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache749617667 pid=912 storage=default gitlab # [ 12.949682] gitaly[912]: time="2026-08-20T05:53:33.793Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=912 gitlab # [ 12.953281] gitaly[912]: time="2026-08-20T05:53:33.793Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=912 gitlab # [ 12.956866] gitaly[912]: time="2026-08-20T05:53:33.793Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache749617667 clear_duration_ms=0 pid=912 storage=default gitlab # [ 12.961997] gitaly[912]: time="2026-08-20T05:53:33.829Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=912 gitlab # [ 12.964787] gitaly[912]: time="2026-08-20T05:53:33.829Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=912 schema=unix gitlab # [ 12.967182] gitaly[912]: time="2026-08-20T05:53:33.829Z" level=info msg="listening at address" address=/run/gitaly/gitaly-912/sock.d/intern pid=912 schema=unix gitlab # [ 12.969612] gitaly[912]: time="2026-08-20T05:53:33.830Z" level=info msg="finished tempdir cleaner walk" pid=912 storage=default time_ms=0 gitlab # [ 12.971761] gitaly[912]: time="2026-08-20T05:53:33.830Z" level=info msg="counting repositories" pid=912 gitlab # [ 12.973721] gitaly[912]: time="2026-08-20T05:53:33.830Z" level=info msg="starting to count repositories" pid=912 storage_path=/var/gitlab/state/repositories gitlab # [ 12.976177] gitaly[912]: time="2026-08-20T05:53:33.831Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=912 storage_path=/var/gitlab/state/repositories gitlab # [ 12.978912] gitaly[912]: time="2026-08-20T05:53:33.831Z" level=info msg="completed counting all repositories" counting_duration=0 pid=912 gitlab # [ 12.981061] gitaly[912]: time="2026-08-20T05:53:33.831Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=912 gitlab # [ 12.982973] gitaly[912]: time="2026-08-20T05:53:33.831Z" level=info msg="Started Gitaly" duration_ms=301 pid=912 gitlab # [ 12.984646] gitaly[912]: time="2026-08-20T05:53:33.831Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=912 gitlab # [ 12.986840] gitaly[912]: time="2026-08-20T05:53:33.832Z" level=info msg="maintenance: daily scheduled" pid=912 scheduled="2026-08-20 12:00:00 +0000 UTC" gitlab # [ 13.462800] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[920]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 13.471087] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[920]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 13.503820] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[920]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 15.327404] dhcpcd[763]: eth0: leased 10.0.2.15 for 86400 seconds gitlab # [ 15.327715] dhcpcd[763]: eth0: adding route to 10.0.2.0/24 gitlab # [ 15.327849] dhcpcd[763]: eth0: adding default route via 10.0.2.2 gitlab # [ 15.490696] systemd[1]: Started DHCP Client. gitlab # [ 15.493659] systemd[1]: Reached target Network is Online. gitlab # [ 16.333752] gitaly[912]: time="2026-08-20T05:53:37.200Z" level=info msg="License database preloaded" duration_ms=3669 pid=912 gitlab # [ 61.522685] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[920]: W, [2026-08-20T05:54:22.388662 #920] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 64.712052] postgres[1463]: [1463] ERROR: relation "feature_gates" does not exist at character 523 gitlab # [ 64.713479] postgres[1463]: [1463] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod), gitlab # [ 64.714698] postgres[1463]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod, gitlab # [ 64.715961] postgres[1463]: c.collname, col_description(a.attrelid, a.attnum) AS comment, gitlab # [ 64.717190] postgres[1463]: attidentity AS identity, gitlab # [ 64.717984] postgres[1463]: attgenerated as attgenerated gitlab # [ 64.718821] postgres[1463]: FROM pg_attribute a gitlab # [ 64.719487] postgres[1463]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum gitlab # [ 64.720784] postgres[1463]: LEFT JOIN pg_type t ON a.atttypid = t.oid gitlab # [ 64.721694] postgres[1463]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation gitlab # [ 64.723070] postgres[1463]: WHERE a.attrelid = '"feature_gates"'::regclass gitlab # [ 64.724039] postgres[1463]: AND a.attnum > 0 AND NOT a.attisdropped gitlab # [ 64.724930] postgres[1463]: ORDER BY a.attnum gitlab # [ 64.725576] postgres[1463]: gitlab # [ 69.941617] gitlab-workhorse[819]: time="2026-08-20T05:54:30Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 69.945928] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1514]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping gitlab # [ 69.952319] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1514]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping gitlab # [ 79.961045] gitlab-workhorse[819]: time="2026-08-20T05:54:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 89.963481] gitlab-workhorse[819]: time="2026-08-20T05:54:50Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 99.611270] postgres[1645]: [1645] ERROR: relation "table_without_models" does not exist gitlab # [ 99.615234] postgres[1645]: [1645] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 99.974289] gitlab-workhorse[819]: time="2026-08-20T05:55:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 109.984609] gitlab-workhorse[819]: time="2026-08-20T05:55:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 119.986181] gitlab-workhorse[819]: time="2026-08-20T05:55:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 129.987466] gitlab-workhorse[819]: time="2026-08-20T05:55:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 130.571818] systemd[1]: Finished gitlab-db-config.service. gitlab # [ 130.578250] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 130.583794] systemd[1]: Starting gitlab.service... gitlab # [ 131.175528] bundle[2029]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 131.182431] bundle[2029]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 131.188550] bundle[2029]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 135.969947] sidekiq-cluster[2028]: {"severity":"INFO","time":"2026-08-20T05:55:36.805Z","message":"Starting cluster with 1 processes"} gitlab # [ 136.058407] bundle[2029]: {"timestamp":"2026-08-20T05:55:36.889Z","pid":2029,"message":"* Enabling systemd notification integration"} gitlab # [ 136.063738] bundle[2029]: {"timestamp":"2026-08-20T05:55:36.925Z","pid":2029,"message":"Puma starting in cluster mode..."} gitlab # [ 136.068480] bundle[2029]: {"timestamp":"2026-08-20T05:55:36.925Z","pid":2029,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"} gitlab # [ 136.073299] bundle[2029]: {"timestamp":"2026-08-20T05:55:36.925Z","pid":2029,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 136.079492] bundle[2029]: {"timestamp":"2026-08-20T05:55:36.925Z","pid":2029,"message":"* Min threads: 0"} gitlab # [ 136.083628] bundle[2029]: {"timestamp":"2026-08-20T05:55:36.925Z","pid":2029,"message":"* Max threads: 4"} gitlab # [ 136.087741] bundle[2029]: {"timestamp":"2026-08-20T05:55:36.925Z","pid":2029,"message":"* Environment: production"} gitlab # [ 136.092384] bundle[2029]: {"timestamp":"2026-08-20T05:55:36.925Z","pid":2029,"message":"* Master PID: 2029"} gitlab # [ 136.096595] bundle[2029]: {"timestamp":"2026-08-20T05:55:36.925Z","pid":2029,"message":"* Workers: 2"} gitlab # [ 136.100914] bundle[2029]: {"timestamp":"2026-08-20T05:55:36.925Z","pid":2029,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"} gitlab # [ 136.106263] bundle[2029]: {"timestamp":"2026-08-20T05:55:36.925Z","pid":2029,"message":"* Preloading application"} gitlab # [ 139.994903] gitlab-workhorse[819]: time="2026-08-20T05:55:40Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 150.005786] gitlab-workhorse[819]: time="2026-08-20T05:55:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 160.014321] gitlab-workhorse[819]: time="2026-08-20T05:56:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 170.024817] gitlab-workhorse[819]: time="2026-08-20T05:56:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 175.734551] bundle[2029]: W, [2026-08-20T05:56:16.600929 #2029] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 179.946319] sidekiq-cluster[2078]: 2026-08-20T05:56:20.812Z pid=2078 tid=xpy INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2078, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>431820800} gitlab # [ 180.034208] gitlab-workhorse[819]: time="2026-08-20T05:56:20Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 180.276270] sidekiq-cluster[2078]: W, [2026-08-20T05:56:21.143461 #2078] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 180.349067] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:21.216Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab # [ 184.798989] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.664Z","message":"GitLab reliable fetch activated!"} gitlab # [ 184.799540] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.665Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 184.850370] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.717Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"} gitlab # [ 184.857856] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.721Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"} gitlab # [ 184.865312] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.724Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"} gitlab # [ 184.872248] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.727Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"} gitlab # [ 184.879952] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.730Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"} gitlab # [ 184.886841] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.733Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"} gitlab # [ 184.893544] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.736Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"} gitlab # [ 184.898801] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.738Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"} gitlab # [ 184.903781] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.740Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"} gitlab # [ 184.908431] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.742Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"} gitlab # [ 184.913051] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.744Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"} gitlab # [ 184.917193] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.747Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"} gitlab # [ 184.920847] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.750Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"} gitlab # [ 184.924504] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.753Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"} gitlab # [ 184.927937] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.756Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"} gitlab # [ 184.931545] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.760Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"} gitlab # [ 184.934806] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.765Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"} gitlab # [ 184.937790] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.770Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"} gitlab # [ 184.940987] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.776Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"} gitlab # [ 184.943694] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.780Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"} gitlab # [ 184.946804] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.784Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"} gitlab # [ 184.949881] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.788Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"} gitlab # [ 184.952487] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.793Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"} gitlab # [ 184.955000] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.798Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"} gitlab # [ 184.957664] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.802Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"} gitlab # [ 184.959995] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.808Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"} gitlab # [ 184.962247] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.813Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"} gitlab # [ 184.964589] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.818Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"} gitlab # [ 184.966899] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.821Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"} gitlab # [ 184.969391] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.825Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"} gitlab # [ 184.971517] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.827Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"} gitlab # [ 184.974063] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.830Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"} gitlab # [ 184.976163] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.833Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"} gitlab # [ 184.978335] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.836Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"} gitlab # [ 184.980470] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.838Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"} gitlab # [ 184.982571] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.840Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"} gitlab # [ 184.984796] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.843Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"} gitlab # [ 184.986808] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.845Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"} gitlab # [ 184.989052] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.847Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"} gitlab # [ 184.991061] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.849Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"} gitlab # [ 184.993379] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.851Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"} gitlab # [ 184.995500] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.854Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"} gitlab # [ 184.999021] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.856Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"} gitlab # [ 185.001237] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.858Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"} gitlab # [ 185.003410] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.860Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"} gitlab # [ 185.005862] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.864Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"} gitlab # [ 185.008000] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.868Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"} gitlab # [ 185.010167] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.872Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"} gitlab # [ 185.012293] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.877Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"} gitlab # [ 185.015488] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.883Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"} gitlab # [ 185.020720] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.888Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"} gitlab # [ 185.026843] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.894Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"} gitlab # [ 185.053924] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.921Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"} gitlab # [ 185.059381] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.926Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"} gitlab # [ 185.064424] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.931Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"} gitlab # [ 185.067825] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.935Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"} gitlab # [ 185.072191] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.938Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"} gitlab # [ 185.076754] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.941Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"} gitlab # [ 185.080890] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.943Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"} gitlab # [ 185.084798] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.947Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"} gitlab # [ 185.088143] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.950Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"} gitlab # [ 185.091364] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.953Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"} gitlab # [ 185.094809] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.955Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"} gitlab # [ 185.098159] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.959Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"} gitlab # [ 185.101427] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.962Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"} gitlab # [ 185.104506] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.966Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"} gitlab # [ 185.107234] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.968Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"} gitlab # [ 185.110190] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.970Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"} gitlab # [ 185.113191] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.973Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"} gitlab # [ 185.115988] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.975Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"} gitlab # [ 185.118663] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.978Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"} gitlab # [ 185.121377] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.980Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"} gitlab # [ 185.123852] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.983Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"} gitlab # [ 185.126667] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.985Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"} gitlab # [ 185.129311] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.989Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"} gitlab # [ 185.131837] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.993Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"} gitlab # [ 185.134432] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:25.999Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"} gitlab # [ 185.137125] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.003Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"} gitlab # [ 185.142839] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.010Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"} gitlab # [ 185.147297] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.014Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"} gitlab # [ 185.152093] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.019Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"} gitlab # [ 185.156447] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.023Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"} gitlab # [ 185.162658] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.030Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"} gitlab # [ 185.167514] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.035Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"} gitlab # [ 185.172553] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.040Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"} gitlab # [ 185.177987] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.045Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"} gitlab # [ 185.183656] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.051Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"} gitlab # [ 185.187786] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.055Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"} gitlab # [ 185.191753] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.059Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"} gitlab # [ 185.195424] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.062Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"} gitlab # [ 185.199116] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.066Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"} gitlab # [ 185.202622] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.068Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"} gitlab # [ 185.207187] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.073Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"} gitlab # [ 185.210702] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.076Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"} gitlab # [ 185.213720] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.080Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"} gitlab # [ 185.217577] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.085Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"} gitlab # [ 185.221487] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.089Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"} gitlab # [ 185.225779] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.093Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"} gitlab # [ 185.247994] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.115Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"} gitlab # [ 185.251821] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.119Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"} gitlab # [ 185.255261] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.122Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"} gitlab # [ 185.260477] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.127Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"} gitlab # [ 185.264702] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.132Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"} gitlab # [ 185.268622] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.136Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"} gitlab # [ 185.272511] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.139Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"} gitlab # [ 185.276408] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.142Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"} gitlab # [ 185.279715] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.144Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"} gitlab # [ 185.334022] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.199Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"} gitlab # [ 185.339854] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:56:26.205Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"} gitlab # [ 190.042519] gitlab-workhorse[819]: time="2026-08-20T05:56:30Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 200.048195] gitlab-workhorse[819]: time="2026-08-20T05:56:40Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 210.049515] gitlab-workhorse[819]: time="2026-08-20T05:56:50Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 220.060667] gitlab-workhorse[819]: time="2026-08-20T05:57:00Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 227.993756] postgres[2842]: [2842] ERROR: relation "table_without_models" does not exist gitlab # [ 227.997471] postgres[2842]: [2842] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 229.506305] postgres[2862]: [2862] ERROR: relation "table_without_models" does not exist gitlab # [ 229.506655] postgres[2862]: [2862] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 230.070666] gitlab-workhorse[819]: time="2026-08-20T05:57:10Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri= gitlab # [ 233.173603] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:14.040Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 233.181423] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:14.048Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 233.183615] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:14.048Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 233.188655] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:14.048Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 233.194925] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:14.054Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab # [ 235.421514] bundle[2029]: {"timestamp":"2026-08-20T05:57:16.287Z","pid":2029,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"} gitlab # [ 235.421847] bundle[2029]: {"timestamp":"2026-08-20T05:57:16.288Z","pid":2029,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"} gitlab # [ 235.422023] bundle[2029]: {"timestamp":"2026-08-20T05:57:16.288Z","pid":2029,"message":"! #\u003cThread:0x0000ecb1e48428c0 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"} gitlab # [ 235.422165] bundle[2029]: {"timestamp":"2026-08-20T05:57:16.288Z","pid":2029,"message":"! #\u003cThread:0x0000ecb1e377fa38 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"} gitlab # [ 235.422284] bundle[2029]: {"timestamp":"2026-08-20T05:57:16.288Z","pid":2029,"message":"Use Ctrl-C to stop"} gitlab # [ 235.422448] bundle[2029]: {"timestamp":"2026-08-20T05:57:16.288Z","pid":2029,"message":"Sending status to systemd every 1.0 sec"} gitlab # [ 235.987923] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:16.854Z","message":"Cleaning working queues"} gitlab # [ 235.992495] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:16.859Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"68ffbb7e5e20ec3959047831","created_at":"2026-08-20T05:55:30.752Z","trace_propagation_headers":{"sentry-trace":"cbec7b4deca34ac48661c54a74ec4e31-7470cc3fc72b47d7","baggage":"sentry-trace_id=cbec7b4deca34ac48661c54a74ec4e31,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"9667ce4184b8f4c2ad92cef5f912b679","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:30.764Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-68ffbb7e5e20ec3959047831: start","job_status":"start","queue_duration_s":106.094553,"scheduling_latency_s":106.094653} gitlab # [ 236.155473] bundle[2029]: {"timestamp":"2026-08-20T05:57:17.022Z","pid":2029,"message":"- Worker 0 (PID: 2964) booted in 0.7s, phase: 0"} gitlab # [ 236.161334] bundle[2029]: {"timestamp":"2026-08-20T05:57:17.025Z","pid":2029,"message":"- Worker 1 (PID: 2968) booted in 0.67s, phase: 0"} gitlab # [ 236.167368] systemd[1]: Started gitlab.service. gitlab # [ 236.169691] systemd[1]: Reached target Common target for all GitLab services.. gitlab # [ 236.172839] systemd[1]: Starting setup-gitlab.service... gitlab # [ 236.194652] setup-gitlab-start[3007]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done' gitlab # [ 236.296827] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:17.163Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"68ffbb7e5e20ec3959047831","created_at":"2026-08-20T05:55:30.752Z","trace_propagation_headers":{"sentry-trace":"cbec7b4deca34ac48661c54a74ec4e31-7470cc3fc72b47d7","baggage":"sentry-trace_id=cbec7b4deca34ac48661c54a74ec4e31,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"9667ce4184b8f4c2ad92cef5f912b679","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:55:30.764Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-68ffbb7e5e20ec3959047831: done: 0.304404 sec","job_status":"done","queue_duration_s":106.094553,"scheduling_latency_s":106.094653,"redis_calls":24,"redis_duration_s":0.006932000000000001,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.003363,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002197,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001372,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.144714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.1829909,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.304404,"completed_at":"2026-08-20T05:57:17.163Z","load_balancing_strategy":"primary","db_duration_s":0.099838,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 239.717454] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:57:20 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 3491 gitlab # [ 239.723184] setup-gitlab-start[3007]: + TOKEN=nixbot-test-token-of-20-chars gitlab # [ 239.726556] setup-gitlab-start[3007]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n' gitlab # [ 239.743496] runuser[3030]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0) gitlab # [ 240.260982] setup-gitlab-start[3031]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 240.267617] setup-gitlab-start[3031]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 240.274211] setup-gitlab-start[3031]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 241.140185] setup-gitlab-start[3031]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 241.140801] setup-gitlab-start[3031]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 241.143238] setup-gitlab-start[3031]: Source locally installed gems is ignoring # because it is missing extensions gitlab # [ 248.601251] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:29.467Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f5ca227979d24d484ee3acc8","created_at":"2026-08-20T05:57:29.366Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3df758fe404993b84ac4b72d05cd092","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.463Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f5ca227979d24d484ee3acc8: start","job_status":"start","queue_duration_s":0.003459,"scheduling_latency_s":0.003521} gitlab # [ 248.775601] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:29.642Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 248.828124] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:29.694Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"f5ca227979d24d484ee3acc8","created_at":"2026-08-20T05:57:29.366Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e3df758fe404993b84ac4b72d05cd092","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.463Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-f5ca227979d24d484ee3acc8: done: 0.227354 sec","job_status":"done","queue_duration_s":0.003459,"scheduling_latency_s":0.003521,"redis_calls":10,"redis_duration_s":0.024486,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002286,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.017544,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004656,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042197,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00187582,"duration_s":0.227354,"completed_at":"2026-08-20T05:57:29.694Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040463,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 248.928601] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:29.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"1f435d46387c1f681ef6d3aa","created_at":"2026-08-20T05:57:29.502Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37c9d5e0821d1c9e32b6470d461e0063","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.519Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-1f435d46387c1f681ef6d3aa: start","job_status":"start","queue_duration_s":0.186531,"scheduling_latency_s":0.186599} gitlab # [ 250.058678] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:30.924Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"1f435d46387c1f681ef6d3aa","created_at":"2026-08-20T05:57:29.502Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37c9d5e0821d1c9e32b6470d461e0063","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.519Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-1f435d46387c1f681ef6d3aa: done: 1.21827 sec","job_status":"done","queue_duration_s":0.186531,"scheduling_latency_s":0.186599,"redis_calls":14,"redis_duration_s":0.024147000000000002,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.008767,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.011341,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.004039,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.189,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.182,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.638371,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0038203,"exclusive_lock_hold_duration_s":1.08329474,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":1.21827,"completed_at":"2026-08-20T05:57:30.924Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.473912,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.060699] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:30.927Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2dd269b9178fbb2819cec82e","created_at":"2026-08-20T05:57:29.526Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5715c3fed472ec2d494d87c875fd5fdd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.547Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2dd269b9178fbb2819cec82e: start","job_status":"start","queue_duration_s":1.379482,"scheduling_latency_s":1.379518} gitlab # [ 250.288118] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.153Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"2dd269b9178fbb2819cec82e","created_at":"2026-08-20T05:57:29.526Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5715c3fed472ec2d494d87c875fd5fdd","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.547Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-2dd269b9178fbb2819cec82e: done: 0.22687 sec","job_status":"done","queue_duration_s":1.379482,"scheduling_latency_s":1.379518,"redis_calls":12,"redis_duration_s":0.006996,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000798,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002742,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.003456,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00160162,"exclusive_lock_hold_duration_s":0.038102859999999995,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.22687,"completed_at":"2026-08-20T05:57:31.153Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.052827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.389004] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.158Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"109a6cf20377eafdb2477335","created_at":"2026-08-20T05:57:29.587Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d5c912cb489cfa85548e46c021358d5","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.598Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-109a6cf20377eafdb2477335: start","job_status":"start","queue_duration_s":1.559144,"scheduling_latency_s":1.559195} gitlab # [ 250.411235] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.231Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"109a6cf20377eafdb2477335","created_at":"2026-08-20T05:57:29.587Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d5c912cb489cfa85548e46c021358d5","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.598Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-109a6cf20377eafdb2477335: done: 0.073353 sec","job_status":"done","queue_duration_s":1.559144,"scheduling_latency_s":1.559195,"redis_calls":16,"redis_duration_s":0.005987,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003161,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00209,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000736,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046005,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056812,"duration_s":0.073353,"completed_at":"2026-08-20T05:57:31.231Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.459570] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.234Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d5d3cf36d1967d7e2c14cebe","created_at":"2026-08-20T05:57:29.623Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2f0927239e0f66974e9c6478250c9aa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.635Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d5d3cf36d1967d7e2c14cebe: start","job_status":"start","queue_duration_s":1.598884,"scheduling_latency_s":1.598918} gitlab # [ 250.474640] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.253Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 250.478612] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d5d3cf36d1967d7e2c14cebe","created_at":"2026-08-20T05:57:29.623Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a2f0927239e0f66974e9c6478250c9aa","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.635Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d5d3cf36d1967d7e2c14cebe: done: 0.030237 sec","job_status":"done","queue_duration_s":1.598884,"scheduling_latency_s":1.598918,"redis_calls":10,"redis_duration_s":0.002933,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000624,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001693,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000616,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004282,"duration_s":0.030237,"completed_at":"2026-08-20T05:57:31.264Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.521427] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.266Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"69b5f7dba5813d9cbdc95251","created_at":"2026-08-20T05:57:29.679Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"406e78c69fe39be8ffefb3e58c52c6fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.700Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-69b5f7dba5813d9cbdc95251: start","job_status":"start","queue_duration_s":1.5662,"scheduling_latency_s":1.566224} gitlab # [ 250.535027] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"69b5f7dba5813d9cbdc95251","created_at":"2026-08-20T05:57:29.679Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"406e78c69fe39be8ffefb3e58c52c6fc","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.700Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-69b5f7dba5813d9cbdc95251: done: 0.037732 sec","job_status":"done","queue_duration_s":1.5662,"scheduling_latency_s":1.566224,"redis_calls":12,"redis_duration_s":0.003483,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000555,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00158,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001348,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00065026,"exclusive_lock_hold_duration_s":0.01122506,"duration_s":0.037732,"completed_at":"2026-08-20T05:57:31.304Z","load_balancing_strategy":"primary","db_duration_s":0.006462,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.578183] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.306Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"e2f06da85c683deba6fcfd2f","created_at":"2026-08-20T05:57:29.737Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abadc442ddcab4ac08aa9c81aa9ec82e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.782Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-e2f06da85c683deba6fcfd2f: start","job_status":"start","queue_duration_s":1.523795,"scheduling_latency_s":1.523822} gitlab # [ 250.593046] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.336Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"e2f06da85c683deba6fcfd2f","created_at":"2026-08-20T05:57:29.737Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"abadc442ddcab4ac08aa9c81aa9ec82e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.782Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-e2f06da85c683deba6fcfd2f: done: 0.030709 sec","job_status":"done","queue_duration_s":1.523795,"scheduling_latency_s":1.523822,"redis_calls":12,"redis_duration_s":0.003811,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001209,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002042,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00056,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038748,"duration_s":0.030709,"completed_at":"2026-08-20T05:57:31.336Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001369,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.636058] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.338Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c412c885d94c8208c3ce0d9b","created_at":"2026-08-20T05:57:29.818Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9f1ca65eb6e1ded3e514c8f5cb91001","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.878Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c412c885d94c8208c3ce0d9b: start","job_status":"start","queue_duration_s":1.459861,"scheduling_latency_s":1.459883} gitlab # [ 250.651119] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.353Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 250.654563] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"c412c885d94c8208c3ce0d9b","created_at":"2026-08-20T05:57:29.818Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b9f1ca65eb6e1ded3e514c8f5cb91001","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.878Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-c412c885d94c8208c3ce0d9b: done: 0.024247 sec","job_status":"done","queue_duration_s":1.459861,"scheduling_latency_s":1.459883,"redis_calls":10,"redis_duration_s":0.0026550000000000002,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000588,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001546,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000521,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036038,"duration_s":0.024247,"completed_at":"2026-08-20T05:57:31.362Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000675,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.697297] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.364Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e243cee967042dc85df324bb","created_at":"2026-08-20T05:57:29.894Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c617766b148cff147d54fb109a7b2545","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:57:29.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e243cee967042dc85df324bb: start","job_status":"start","queue_duration_s":1.457554,"scheduling_latency_s":1.457574} gitlab # [ 250.710553] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.402Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"e243cee967042dc85df324bb","created_at":"2026-08-20T05:57:29.894Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c617766b148cff147d54fb109a7b2545","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:57:29.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-e243cee967042dc85df324bb: done: 0.038264 sec","job_status":"done","queue_duration_s":1.457554,"scheduling_latency_s":1.457574,"redis_calls":10,"redis_duration_s":0.002515,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000489,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001522,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003455,"duration_s":0.038264,"completed_at":"2026-08-20T05:57:31.402Z","load_balancing_strategy":"primary","db_duration_s":0.007451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.752259] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.404Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3403f039eccd0d06327dbe70","created_at":"2026-08-20T05:57:29.919Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"545236f989e17ae67ac04b4382e48d07","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.929Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3403f039eccd0d06327dbe70: start","job_status":"start","queue_duration_s":1.474553,"scheduling_latency_s":1.474572} gitlab # [ 250.766717] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.437Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"3403f039eccd0d06327dbe70","created_at":"2026-08-20T05:57:29.919Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"545236f989e17ae67ac04b4382e48d07","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.929Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-3403f039eccd0d06327dbe70: done: 0.033078 sec","job_status":"done","queue_duration_s":1.474553,"scheduling_latency_s":1.474572,"redis_calls":12,"redis_duration_s":0.005041,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002491,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00163,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015542,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00057682,"exclusive_lock_hold_duration_s":0.0067274399999999995,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.033078,"completed_at":"2026-08-20T05:57:31.437Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004974,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.812184] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.439Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"58b801987888f4224d940d53","created_at":"2026-08-20T05:57:29.936Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5558852b4e9d18171bc17448d14359f4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:57:29.944Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-58b801987888f4224d940d53: start","job_status":"start","queue_duration_s":1.494202,"scheduling_latency_s":1.494223} gitlab # [ 250.825700] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.452Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 250.829440] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"58b801987888f4224d940d53","created_at":"2026-08-20T05:57:29.936Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5558852b4e9d18171bc17448d14359f4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:57:29.944Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-58b801987888f4224d940d53: done: 0.020836 sec","job_status":"done","queue_duration_s":1.494202,"scheduling_latency_s":1.494223,"redis_calls":10,"redis_duration_s":0.001652,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000381,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000329,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012582,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002342,"duration_s":0.020836,"completed_at":"2026-08-20T05:57:31.459Z","load_balancing_strategy":"primary","db_duration_s":0.000817,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.871184] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.461Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3c220ac3774a52536f4fdc29","created_at":"2026-08-20T05:57:29.951Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6854dbd6c942c6875128fef0fa577127","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.960Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3c220ac3774a52536f4fdc29: start","job_status":"start","queue_duration_s":1.500664,"scheduling_latency_s":1.500685} gitlab # [ 250.885750] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.481Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"3c220ac3774a52536f4fdc29","created_at":"2026-08-20T05:57:29.951Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6854dbd6c942c6875128fef0fa577127","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:29.960Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-3c220ac3774a52536f4fdc29: done: 0.020217 sec","job_status":"done","queue_duration_s":1.500664,"scheduling_latency_s":1.500685,"redis_calls":10,"redis_duration_s":0.001972,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00027,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0014,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000302,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012135,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023556,"duration_s":0.020217,"completed_at":"2026-08-20T05:57:31.481Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00065,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.928858] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.482Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"16bf7c05c9b4eb197e7fdb61","created_at":"2026-08-20T05:57:29.986Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"634c93ec74f219441077b27e063601cd","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.011Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-16bf7c05c9b4eb197e7fdb61: start","job_status":"start","queue_duration_s":1.47111,"scheduling_latency_s":1.471128} gitlab # [ 250.943088] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.806Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"16bf7c05c9b4eb197e7fdb61","created_at":"2026-08-20T05:57:29.986Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"634c93ec74f219441077b27e063601cd","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.011Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-16bf7c05c9b4eb197e7fdb61: done: 0.324461 sec","job_status":"done","queue_duration_s":1.47111,"scheduling_latency_s":1.471128,"redis_calls":565,"redis_duration_s":0.056413,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000775,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.055367,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.29907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002519,"duration_s":0.324461,"completed_at":"2026-08-20T05:57:31.806Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000668,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 250.987087] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6dd952e89a0345637213d4ce","created_at":"2026-08-20T05:57:30.019Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1987a5915a306b059bddee19e8ebcb40","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:57:30.039Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6dd952e89a0345637213d4ce: start","job_status":"start","queue_duration_s":1.768604,"scheduling_latency_s":1.768631} gitlab # [ 251.000872] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.821Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 251.004102] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.829Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"6dd952e89a0345637213d4ce","created_at":"2026-08-20T05:57:30.019Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1987a5915a306b059bddee19e8ebcb40","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:57:30.039Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-6dd952e89a0345637213d4ce: done: 0.021271 sec","job_status":"done","queue_duration_s":1.768604,"scheduling_latency_s":1.768631,"redis_calls":10,"redis_duration_s":0.0014060000000000001,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000305,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000773,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000328,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002528,"duration_s":0.021271,"completed_at":"2026-08-20T05:57:31.829Z","load_balancing_strategy":"primary","db_duration_s":0.000774,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.045263] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.831Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"443d21c66d9a90dac30d3c82","created_at":"2026-08-20T05:57:30.077Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f162087ac200d7cf300178a1e501d9a","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.115Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-443d21c66d9a90dac30d3c82: start","job_status":"start","queue_duration_s":1.715933,"scheduling_latency_s":1.715958} gitlab # [ 251.060210] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.868Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"443d21c66d9a90dac30d3c82","created_at":"2026-08-20T05:57:30.077Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6f162087ac200d7cf300178a1e501d9a","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.115Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-443d21c66d9a90dac30d3c82: done: 0.037392 sec","job_status":"done","queue_duration_s":1.715933,"scheduling_latency_s":1.715958,"redis_calls":13,"redis_duration_s":0.002266,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00036,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001174,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000732,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023745,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.011903200000000001,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.037392,"completed_at":"2026-08-20T05:57:31.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006017,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 251.104661] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.870Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2fdde76c08e0147dd3ba5ee6","created_at":"2026-08-20T05:57:30.182Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"326ddd14f6fbc9db7f251e7529fe915f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.208Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2fdde76c08e0147dd3ba5ee6: start","job_status":"start","queue_duration_s":1.66197,"scheduling_latency_s":1.66199} gitlab # [ 251.118746] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.896Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2fdde76c08e0147dd3ba5ee6","created_at":"2026-08-20T05:57:30.182Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"326ddd14f6fbc9db7f251e7529fe915f","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.208Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2fdde76c08e0147dd3ba5ee6: done: 0.02673 sec","job_status":"done","queue_duration_s":1.66197,"scheduling_latency_s":1.66199,"redis_calls":10,"redis_duration_s":0.001307,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000264,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000295,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00025446,"duration_s":0.02673,"completed_at":"2026-08-20T05:57:31.896Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004381,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.160888] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.898Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a109f246de9d3b7e202ef35f","created_at":"2026-08-20T05:57:30.300Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d8dbd37a250b475e9370bac778daf93","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.326Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a109f246de9d3b7e202ef35f: start","job_status":"start","queue_duration_s":1.571809,"scheduling_latency_s":1.571829} gitlab # [ 251.175395] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"a109f246de9d3b7e202ef35f","created_at":"2026-08-20T05:57:30.300Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9d8dbd37a250b475e9370bac778daf93","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.326Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-a109f246de9d3b7e202ef35f: done: 0.064915 sec","job_status":"done","queue_duration_s":1.571809,"scheduling_latency_s":1.571829,"redis_calls":12,"redis_duration_s":0.0027410000000000004,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000271,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001427,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001043,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00052014,"exclusive_lock_hold_duration_s":0.0343783,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.064915,"completed_at":"2026-08-20T05:57:31.962Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.019961,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.222770] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.966Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"de877fcd87d047d849511f3c","created_at":"2026-08-20T05:57:30.371Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cef33a1138a8b3c381740d1871a471f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.402Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-de877fcd87d047d849511f3c: start","job_status":"start","queue_duration_s":1.563604,"scheduling_latency_s":1.56365} gitlab # [ 251.237387] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:31.996Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 251.240956] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.012Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"de877fcd87d047d849511f3c","created_at":"2026-08-20T05:57:30.371Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2cef33a1138a8b3c381740d1871a471f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.402Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-de877fcd87d047d849511f3c: done: 0.046226 sec","job_status":"done","queue_duration_s":1.563604,"scheduling_latency_s":1.56365,"redis_calls":10,"redis_duration_s":0.003829,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000704,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002273,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000852,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00065468,"duration_s":0.046226,"completed_at":"2026-08-20T05:57:32.012Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.283976] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.015Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"fbc74d5f80cc5f4f00a69117","created_at":"2026-08-20T05:57:30.460Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.491Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-fbc74d5f80cc5f4f00a69117: start","job_status":"start","queue_duration_s":1.524418,"scheduling_latency_s":1.524459} gitlab # [ 251.378054] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.244Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"fbc74d5f80cc5f4f00a69117","created_at":"2026-08-20T05:57:30.460Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.491Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-fbc74d5f80cc5f4f00a69117: done: 0.229427 sec","job_status":"done","queue_duration_s":1.524418,"scheduling_latency_s":1.524459,"redis_calls":71,"redis_duration_s":0.025209000000000002,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.003849,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.001898,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.018436,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001026,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.201862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004227,"duration_s":0.229427,"completed_at":"2026-08-20T05:57:32.244Z","load_balancing_strategy":"primary","db_duration_s":0.004456,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.462470] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.246Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"30d2708d8e5335fbf68a356a","created_at":"2026-08-20T05:57:30.557Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5524bd45b675a984fbde16feab575bbe","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.595Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-30d2708d8e5335fbf68a356a: start","job_status":"start","queue_duration_s":1.650969,"scheduling_latency_s":1.651004} gitlab # [ 251.479980] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.319Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"30d2708d8e5335fbf68a356a","created_at":"2026-08-20T05:57:30.557Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5524bd45b675a984fbde16feab575bbe","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.595Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-30d2708d8e5335fbf68a356a: done: 0.073 sec","job_status":"done","queue_duration_s":1.650969,"scheduling_latency_s":1.651004,"redis_calls":10,"redis_duration_s":0.003339,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000744,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001921,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000674,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006531,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.073,"completed_at":"2026-08-20T05:57:32.319Z","load_balancing_strategy":"primary","db_duration_s":0.019906,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.524034] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.323Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"68e2ac47614644505d3b17f0","created_at":"2026-08-20T05:57:30.626Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8a2f68866e8efbd5adaee5af5cd2dcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.666Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-68e2ac47614644505d3b17f0: start","job_status":"start","queue_duration_s":1.657079,"scheduling_latency_s":1.657131} gitlab # [ 251.537391] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.388Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"68e2ac47614644505d3b17f0","created_at":"2026-08-20T05:57:30.626Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b8a2f68866e8efbd5adaee5af5cd2dcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:57:30.666Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-68e2ac47614644505d3b17f0: done: 0.064845 sec","job_status":"done","queue_duration_s":1.657079,"scheduling_latency_s":1.657131,"redis_calls":19,"redis_duration_s":0.0059169999999999995,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001282,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000472,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.003093,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00107,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039486,"duration_s":0.064845,"completed_at":"2026-08-20T05:57:32.388Z","load_balancing_strategy":"primary","db_duration_s":0.002966,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.582312] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.390Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8038dedd58126dda7d3e08a","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8038dedd58126dda7d3e08a: start","job_status":"start","queue_duration_s":0.159357,"scheduling_latency_s":0.159392} gitlab # [ 251.596905] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.421Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8038dedd58126dda7d3e08a","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8038dedd58126dda7d3e08a: done: 0.030933 sec","job_status":"done","queue_duration_s":0.159357,"scheduling_latency_s":0.159392,"redis_calls":16,"redis_duration_s":0.004651,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000493,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001439,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002719,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018266,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037436,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.030933,"completed_at":"2026-08-20T05:57:32.421Z","load_balancing_strategy":"primary","db_duration_s":0.000455,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.638891] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.422Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73b81b475ecd3c0fa6bf1f83","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73b81b475ecd3c0fa6bf1f83: start","job_status":"start","queue_duration_s":0.191991,"scheduling_latency_s":0.192024} gitlab # [ 251.651786] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73b81b475ecd3c0fa6bf1f83","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73b81b475ecd3c0fa6bf1f83: done: 0.020686 sec","job_status":"done","queue_duration_s":0.191991,"scheduling_latency_s":0.192024,"redis_calls":13,"redis_duration_s":0.003364,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001003,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002361,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020686,"completed_at":"2026-08-20T05:57:32.443Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.692525] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7eaea03dae6ea32291740d14","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7eaea03dae6ea32291740d14: start","job_status":"start","queue_duration_s":0.214296,"scheduling_latency_s":0.214327} gitlab # [ 251.704743] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7eaea03dae6ea32291740d14","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7eaea03dae6ea32291740d14: done: 0.017875 sec","job_status":"done","queue_duration_s":0.214296,"scheduling_latency_s":0.214327,"redis_calls":13,"redis_duration_s":0.0028190000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001002,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001817,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010774,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017875,"completed_at":"2026-08-20T05:57:32.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.744650] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f7498492a070e8c3478907d","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f7498492a070e8c3478907d: start","job_status":"start","queue_duration_s":0.233811,"scheduling_latency_s":0.233831} gitlab # [ 251.757210] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.485Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3f7498492a070e8c3478907d","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3f7498492a070e8c3478907d: done: 0.020434 sec","job_status":"done","queue_duration_s":0.233811,"scheduling_latency_s":0.233831,"redis_calls":13,"redis_duration_s":0.005525,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000851,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004674,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011165,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020434,"completed_at":"2026-08-20T05:57:32.485Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.798175] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.487Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14b981c4e89d940c3d6e2c49","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14b981c4e89d940c3d6e2c49: start","job_status":"start","queue_duration_s":0.25607,"scheduling_latency_s":0.256093} gitlab # [ 251.811084] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.508Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14b981c4e89d940c3d6e2c49","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14b981c4e89d940c3d6e2c49: done: 0.021952 sec","job_status":"done","queue_duration_s":0.25607,"scheduling_latency_s":0.256093,"redis_calls":13,"redis_duration_s":0.006336,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.005235,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021952,"completed_at":"2026-08-20T05:57:32.508Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.852132] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdb4eda4f837464b0a123e66","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdb4eda4f837464b0a123e66: start","job_status":"start","queue_duration_s":0.282333,"scheduling_latency_s":0.282358} gitlab # [ 251.865069] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bdb4eda4f837464b0a123e66","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bdb4eda4f837464b0a123e66: done: 0.018762 sec","job_status":"done","queue_duration_s":0.282333,"scheduling_latency_s":0.282358,"redis_calls":13,"redis_duration_s":0.003791,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002301,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00149,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018762,"completed_at":"2026-08-20T05:57:32.531Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.904752] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cff7c8e3b0e313e339eff10","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cff7c8e3b0e313e339eff10: start","job_status":"start","queue_duration_s":0.302717,"scheduling_latency_s":0.302739} gitlab # [ 251.917373] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.551Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1cff7c8e3b0e313e339eff10","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1cff7c8e3b0e313e339eff10: done: 0.018164 sec","job_status":"done","queue_duration_s":0.302717,"scheduling_latency_s":0.302739,"redis_calls":13,"redis_duration_s":0.002943,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001956,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018164,"completed_at":"2026-08-20T05:57:32.551Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 251.957274] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb18234c6f372d6b1c1489e5","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb18234c6f372d6b1c1489e5: start","job_status":"start","queue_duration_s":0.322426,"scheduling_latency_s":0.322447} gitlab # [ 251.969779] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.568Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb18234c6f372d6b1c1489e5","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb18234c6f372d6b1c1489e5: done: 0.015503 sec","job_status":"done","queue_duration_s":0.322426,"scheduling_latency_s":0.322447,"redis_calls":13,"redis_duration_s":0.002535,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001593,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015503,"completed_at":"2026-08-20T05:57:32.568Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.010221] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90a05f4dd6c3d9c7e3d46f3c","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90a05f4dd6c3d9c7e3d46f3c: start","job_status":"start","queue_duration_s":0.339581,"scheduling_latency_s":0.339603} gitlab # [ 252.022901] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.586Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"90a05f4dd6c3d9c7e3d46f3c","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-90a05f4dd6c3d9c7e3d46f3c: done: 0.016151 sec","job_status":"done","queue_duration_s":0.339581,"scheduling_latency_s":0.339603,"redis_calls":13,"redis_duration_s":0.002709,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001748,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016151,"completed_at":"2026-08-20T05:57:32.586Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.062550] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.588Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21214aa1898c05e2bdd57a49","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21214aa1898c05e2bdd57a49: start","job_status":"start","queue_duration_s":0.357238,"scheduling_latency_s":0.35726} gitlab # [ 252.075064] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21214aa1898c05e2bdd57a49","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21214aa1898c05e2bdd57a49: done: 0.016441 sec","job_status":"done","queue_duration_s":0.357238,"scheduling_latency_s":0.35726,"redis_calls":13,"redis_duration_s":0.00266,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016441,"completed_at":"2026-08-20T05:57:32.604Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.114286] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc520f30875a83994adbc145","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc520f30875a83994adbc145: start","job_status":"start","queue_duration_s":0.375107,"scheduling_latency_s":0.375127} gitlab # [ 252.126736] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc520f30875a83994adbc145","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc520f30875a83994adbc145: done: 0.016631 sec","job_status":"done","queue_duration_s":0.375107,"scheduling_latency_s":0.375127,"redis_calls":13,"redis_duration_s":0.0028380000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001015,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001823,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010234,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016631,"completed_at":"2026-08-20T05:57:32.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.165575] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.624Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c900cf3bb8eba86908726e75","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c900cf3bb8eba86908726e75: start","job_status":"start","queue_duration_s":0.393298,"scheduling_latency_s":0.39332} gitlab # [ 252.177942] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.640Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c900cf3bb8eba86908726e75","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c900cf3bb8eba86908726e75: done: 0.01674 sec","job_status":"done","queue_duration_s":0.393298,"scheduling_latency_s":0.39332,"redis_calls":13,"redis_duration_s":0.003421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01674,"completed_at":"2026-08-20T05:57:32.640Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.219904] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f08f96ff8349cb70d10ca29","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f08f96ff8349cb70d10ca29: start","job_status":"start","queue_duration_s":0.411374,"scheduling_latency_s":0.411391} gitlab # [ 252.233282] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f08f96ff8349cb70d10ca29","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f08f96ff8349cb70d10ca29: done: 0.018179 sec","job_status":"done","queue_duration_s":0.411374,"scheduling_latency_s":0.411391,"redis_calls":13,"redis_duration_s":0.004802,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001277,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003525,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018179,"completed_at":"2026-08-20T05:57:32.660Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.275313] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0d7285b54190a2ef4b55e68","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0d7285b54190a2ef4b55e68: start","job_status":"start","queue_duration_s":0.43097,"scheduling_latency_s":0.430988} gitlab # [ 252.288845] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0d7285b54190a2ef4b55e68","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0d7285b54190a2ef4b55e68: done: 0.016059 sec","job_status":"done","queue_duration_s":0.43097,"scheduling_latency_s":0.430988,"redis_calls":13,"redis_duration_s":0.002774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001834,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009757,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016059,"completed_at":"2026-08-20T05:57:32.677Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.328571] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c873d5f85db44f848d5460d4","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c873d5f85db44f848d5460d4: start","job_status":"start","queue_duration_s":0.448453,"scheduling_latency_s":0.448484} gitlab # [ 252.341068] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c873d5f85db44f848d5460d4","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c873d5f85db44f848d5460d4: done: 0.015921 sec","job_status":"done","queue_duration_s":0.448453,"scheduling_latency_s":0.448484,"redis_calls":13,"redis_duration_s":0.0028770000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000965,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015921,"completed_at":"2026-08-20T05:57:32.695Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.380714] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d7b74c21e1189f192edc8de","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d7b74c21e1189f192edc8de: start","job_status":"start","queue_duration_s":0.465885,"scheduling_latency_s":0.465903} gitlab # [ 252.393140] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d7b74c21e1189f192edc8de","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d7b74c21e1189f192edc8de: done: 0.016092 sec","job_status":"done","queue_duration_s":0.465885,"scheduling_latency_s":0.465903,"redis_calls":13,"redis_duration_s":0.002774,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001823,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016092,"completed_at":"2026-08-20T05:57:32.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.434372] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.714Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37f5a0954efd9d5aa9a1a038","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37f5a0954efd9d5aa9a1a038: start","job_status":"start","queue_duration_s":0.483723,"scheduling_latency_s":0.483742} gitlab # [ 252.447095] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.731Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"37f5a0954efd9d5aa9a1a038","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-37f5a0954efd9d5aa9a1a038: done: 0.016452 sec","job_status":"done","queue_duration_s":0.483723,"scheduling_latency_s":0.483742,"redis_calls":13,"redis_duration_s":0.0029950000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010426,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016452,"completed_at":"2026-08-20T05:57:32.731Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.488373] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d1349931a55c3f3f389f2f0","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d1349931a55c3f3f389f2f0: start","job_status":"start","queue_duration_s":0.501733,"scheduling_latency_s":0.501752} gitlab # [ 252.500904] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d1349931a55c3f3f389f2f0","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d1349931a55c3f3f389f2f0: done: 0.016296 sec","job_status":"done","queue_duration_s":0.501733,"scheduling_latency_s":0.501752,"redis_calls":13,"redis_duration_s":0.003291,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002349,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010098,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016296,"completed_at":"2026-08-20T05:57:32.748Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.540723] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"143499ebd90677d9522cf676","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-143499ebd90677d9522cf676: start","job_status":"start","queue_duration_s":0.519551,"scheduling_latency_s":0.519569} gitlab # [ 252.553366] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.766Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"143499ebd90677d9522cf676","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-143499ebd90677d9522cf676: done: 0.015626 sec","job_status":"done","queue_duration_s":0.519551,"scheduling_latency_s":0.519569,"redis_calls":13,"redis_duration_s":0.002755,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001788,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015626,"completed_at":"2026-08-20T05:57:32.766Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.592993] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.767Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c641b27375d2d1bb1d402e0","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c641b27375d2d1bb1d402e0: start","job_status":"start","queue_duration_s":0.53677,"scheduling_latency_s":0.536789} gitlab # [ 252.606511] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4c641b27375d2d1bb1d402e0","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4c641b27375d2d1bb1d402e0: done: 0.015783 sec","job_status":"done","queue_duration_s":0.53677,"scheduling_latency_s":0.536789,"redis_calls":13,"redis_duration_s":0.002734,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009836,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015783,"completed_at":"2026-08-20T05:57:32.783Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.646215] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4b0531bb3ed4c09eac6661c","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4b0531bb3ed4c09eac6661c: start","job_status":"start","queue_duration_s":0.553862,"scheduling_latency_s":0.553881} gitlab # [ 252.658828] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4b0531bb3ed4c09eac6661c","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4b0531bb3ed4c09eac6661c: done: 0.016073 sec","job_status":"done","queue_duration_s":0.553862,"scheduling_latency_s":0.553881,"redis_calls":13,"redis_duration_s":0.002548,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001602,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016073,"completed_at":"2026-08-20T05:57:32.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.698439] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.802Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f46d923e9523993fab466316","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f46d923e9523993fab466316: start","job_status":"start","queue_duration_s":0.571315,"scheduling_latency_s":0.571333} gitlab # [ 252.711081] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f46d923e9523993fab466316","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f46d923e9523993fab466316: done: 0.016093 sec","job_status":"done","queue_duration_s":0.571315,"scheduling_latency_s":0.571333,"redis_calls":13,"redis_duration_s":0.002846,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000996,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00185,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016093,"completed_at":"2026-08-20T05:57:32.818Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.751595] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.819Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9f9a194a6e29aac612588c1","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9f9a194a6e29aac612588c1: start","job_status":"start","queue_duration_s":0.588896,"scheduling_latency_s":0.588915} gitlab # [ 252.764194] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.836Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c9f9a194a6e29aac612588c1","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c9f9a194a6e29aac612588c1: done: 0.016326 sec","job_status":"done","queue_duration_s":0.588896,"scheduling_latency_s":0.588915,"redis_calls":13,"redis_duration_s":0.002861,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001918,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016326,"completed_at":"2026-08-20T05:57:32.836Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.803986] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.837Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e5859fdf5b051b05dea9b5a","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e5859fdf5b051b05dea9b5a: start","job_status":"start","queue_duration_s":0.606544,"scheduling_latency_s":0.606561} gitlab # [ 252.817750] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.853Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e5859fdf5b051b05dea9b5a","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e5859fdf5b051b05dea9b5a: done: 0.015626 sec","job_status":"done","queue_duration_s":0.606544,"scheduling_latency_s":0.606561,"redis_calls":13,"redis_duration_s":0.002711,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001781,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009609,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015626,"completed_at":"2026-08-20T05:57:32.853Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.857063] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.854Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6ff2e28f02d70c42ce6076f","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6ff2e28f02d70c42ce6076f: start","job_status":"start","queue_duration_s":0.623508,"scheduling_latency_s":0.623524} gitlab # [ 252.869591] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a6ff2e28f02d70c42ce6076f","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a6ff2e28f02d70c42ce6076f: done: 0.0157 sec","job_status":"done","queue_duration_s":0.623508,"scheduling_latency_s":0.623524,"redis_calls":13,"redis_duration_s":0.0028079999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000974,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001834,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.0157,"completed_at":"2026-08-20T05:57:32.870Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.909232] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7256d2dc8e1597c89135b698","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7256d2dc8e1597c89135b698: start","job_status":"start","queue_duration_s":0.640593,"scheduling_latency_s":0.640611} gitlab # [ 252.921940] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7256d2dc8e1597c89135b698","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7256d2dc8e1597c89135b698: done: 0.015741 sec","job_status":"done","queue_duration_s":0.640593,"scheduling_latency_s":0.640611,"redis_calls":13,"redis_duration_s":0.002694,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000999,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001695,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009641,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015741,"completed_at":"2026-08-20T05:57:32.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 252.962786] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55f7569e48f569a25194c53f","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55f7569e48f569a25194c53f: start","job_status":"start","queue_duration_s":0.658199,"scheduling_latency_s":0.658219} gitlab # [ 252.975345] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55f7569e48f569a25194c53f","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55f7569e48f569a25194c53f: done: 0.015913 sec","job_status":"done","queue_duration_s":0.658199,"scheduling_latency_s":0.658219,"redis_calls":13,"redis_duration_s":0.002688,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00172,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015913,"completed_at":"2026-08-20T05:57:32.905Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.016987] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.906Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"887ee5c229bdaac151a88765","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-887ee5c229bdaac151a88765: start","job_status":"start","queue_duration_s":0.675714,"scheduling_latency_s":0.675733} gitlab # [ 253.029792] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"887ee5c229bdaac151a88765","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-887ee5c229bdaac151a88765: done: 0.015551 sec","job_status":"done","queue_duration_s":0.675714,"scheduling_latency_s":0.675733,"redis_calls":13,"redis_duration_s":0.002894,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001779,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015551,"completed_at":"2026-08-20T05:57:32.922Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.069844] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9a43c5c288fe680c7abe372","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9a43c5c288fe680c7abe372: start","job_status":"start","queue_duration_s":0.692781,"scheduling_latency_s":0.692799} gitlab # [ 253.082658] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9a43c5c288fe680c7abe372","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9a43c5c288fe680c7abe372: done: 0.015566 sec","job_status":"done","queue_duration_s":0.692781,"scheduling_latency_s":0.692799,"redis_calls":13,"redis_duration_s":0.002771,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001839,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015566,"completed_at":"2026-08-20T05:57:32.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.122903] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9609a0fbb8960a08cbcc3c51","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9609a0fbb8960a08cbcc3c51: start","job_status":"start","queue_duration_s":0.709971,"scheduling_latency_s":0.709989} gitlab # [ 253.135412] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9609a0fbb8960a08cbcc3c51","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9609a0fbb8960a08cbcc3c51: done: 0.015557 sec","job_status":"done","queue_duration_s":0.709971,"scheduling_latency_s":0.709989,"redis_calls":13,"redis_duration_s":0.002707,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001779,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015557,"completed_at":"2026-08-20T05:57:32.956Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.175636] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.957Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99b7c55fc0e38afd31704c51","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99b7c55fc0e38afd31704c51: start","job_status":"start","queue_duration_s":0.726877,"scheduling_latency_s":0.726895} gitlab # [ 253.188468] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"99b7c55fc0e38afd31704c51","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-99b7c55fc0e38afd31704c51: done: 0.015831 sec","job_status":"done","queue_duration_s":0.726877,"scheduling_latency_s":0.726895,"redis_calls":13,"redis_duration_s":0.002731,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000923,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00999,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015831,"completed_at":"2026-08-20T05:57:32.973Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.230005] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4105b2eb8b99563a508f30fc","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4105b2eb8b99563a508f30fc: start","job_status":"start","queue_duration_s":0.744065,"scheduling_latency_s":0.744083} gitlab # [ 253.242927] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4105b2eb8b99563a508f30fc","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4105b2eb8b99563a508f30fc: done: 0.015813 sec","job_status":"done","queue_duration_s":0.744065,"scheduling_latency_s":0.744083,"redis_calls":13,"redis_duration_s":0.002876,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000945,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015813,"completed_at":"2026-08-20T05:57:32.990Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.283547] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:32.992Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06dac6cfe48ec97458556f40","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06dac6cfe48ec97458556f40: start","job_status":"start","queue_duration_s":0.761314,"scheduling_latency_s":0.761332} gitlab # [ 253.296600] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.008Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"06dac6cfe48ec97458556f40","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-06dac6cfe48ec97458556f40: done: 0.015791 sec","job_status":"done","queue_duration_s":0.761314,"scheduling_latency_s":0.761332,"redis_calls":13,"redis_duration_s":0.00281,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009646,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015791,"completed_at":"2026-08-20T05:57:33.007Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.336180] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.009Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8bce2d402612666ec19970b","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8bce2d402612666ec19970b: start","job_status":"start","queue_duration_s":0.778414,"scheduling_latency_s":0.778431} gitlab # [ 253.348528] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.026Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e8bce2d402612666ec19970b","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e8bce2d402612666ec19970b: done: 0.016967 sec","job_status":"done","queue_duration_s":0.778414,"scheduling_latency_s":0.778431,"redis_calls":13,"redis_duration_s":0.003705,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009883,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016967,"completed_at":"2026-08-20T05:57:33.026Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.388304] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45dc079fdba6179c0061cbf0","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45dc079fdba6179c0061cbf0: start","job_status":"start","queue_duration_s":0.796803,"scheduling_latency_s":0.796822} gitlab # [ 253.400563] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.044Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45dc079fdba6179c0061cbf0","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45dc079fdba6179c0061cbf0: done: 0.016341 sec","job_status":"done","queue_duration_s":0.796803,"scheduling_latency_s":0.796822,"redis_calls":13,"redis_duration_s":0.003203,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016341,"completed_at":"2026-08-20T05:57:33.044Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.441478] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.045Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc4eee50ce283b0459eb8f1b","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc4eee50ce283b0459eb8f1b: start","job_status":"start","queue_duration_s":0.81452,"scheduling_latency_s":0.814538} gitlab # [ 253.454191] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fc4eee50ce283b0459eb8f1b","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fc4eee50ce283b0459eb8f1b: done: 0.015865 sec","job_status":"done","queue_duration_s":0.81452,"scheduling_latency_s":0.814538,"redis_calls":13,"redis_duration_s":0.002726,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001768,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015865,"completed_at":"2026-08-20T05:57:33.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.493820] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6155104592a8c9eec73d0a4","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6155104592a8c9eec73d0a4: start","job_status":"start","queue_duration_s":0.831983,"scheduling_latency_s":0.832003} gitlab # [ 253.506430] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6155104592a8c9eec73d0a4","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6155104592a8c9eec73d0a4: done: 0.016034 sec","job_status":"done","queue_duration_s":0.831983,"scheduling_latency_s":0.832003,"redis_calls":13,"redis_duration_s":0.002824,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000954,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00187,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010054,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016034,"completed_at":"2026-08-20T05:57:33.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.547638] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1deaf2d988011e5cb0d480c8","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1deaf2d988011e5cb0d480c8: start","job_status":"start","queue_duration_s":0.849628,"scheduling_latency_s":0.849646} gitlab # [ 253.560670] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1deaf2d988011e5cb0d480c8","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1deaf2d988011e5cb0d480c8: done: 0.015937 sec","job_status":"done","queue_duration_s":0.849628,"scheduling_latency_s":0.849646,"redis_calls":13,"redis_duration_s":0.002918,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015937,"completed_at":"2026-08-20T05:57:33.096Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.600812] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74af1565b2b56f18a0ce493a","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74af1565b2b56f18a0ce493a: start","job_status":"start","queue_duration_s":0.867123,"scheduling_latency_s":0.867141} gitlab # [ 253.613571] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.113Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74af1565b2b56f18a0ce493a","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74af1565b2b56f18a0ce493a: done: 0.015542 sec","job_status":"done","queue_duration_s":0.867123,"scheduling_latency_s":0.867141,"redis_calls":13,"redis_duration_s":0.00268,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001773,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015542,"completed_at":"2026-08-20T05:57:33.113Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.654743] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"544b431ca073365176f6faa4","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-544b431ca073365176f6faa4: start","job_status":"start","queue_duration_s":0.88422,"scheduling_latency_s":0.884238} gitlab # [ 253.667679] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"544b431ca073365176f6faa4","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-544b431ca073365176f6faa4: done: 0.01562 sec","job_status":"done","queue_duration_s":0.88422,"scheduling_latency_s":0.884238,"redis_calls":13,"redis_duration_s":0.0027790000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01562,"completed_at":"2026-08-20T05:57:33.130Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.709045] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.132Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3787c4a073512ded554ddd1","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3787c4a073512ded554ddd1: start","job_status":"start","queue_duration_s":0.901454,"scheduling_latency_s":0.901474} gitlab # [ 253.721873] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c3787c4a073512ded554ddd1","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c3787c4a073512ded554ddd1: done: 0.016502 sec","job_status":"done","queue_duration_s":0.901454,"scheduling_latency_s":0.901474,"redis_calls":13,"redis_duration_s":0.003254,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002338,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016502,"completed_at":"2026-08-20T05:57:33.148Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.762773] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14fba5c634b1a316ddb85011","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14fba5c634b1a316ddb85011: start","job_status":"start","queue_duration_s":0.919341,"scheduling_latency_s":0.919359} gitlab # [ 253.775743] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.166Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"14fba5c634b1a316ddb85011","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-14fba5c634b1a316ddb85011: done: 0.016032 sec","job_status":"done","queue_duration_s":0.919341,"scheduling_latency_s":0.919359,"redis_calls":13,"redis_duration_s":0.00302,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00199,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009998,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016032,"completed_at":"2026-08-20T05:57:33.166Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.815929] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.167Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7963f72568abcbd7cf7413ff","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7963f72568abcbd7cf7413ff: start","job_status":"start","queue_duration_s":0.936998,"scheduling_latency_s":0.937017} gitlab # [ 253.830033] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7963f72568abcbd7cf7413ff","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7963f72568abcbd7cf7413ff: done: 0.015999 sec","job_status":"done","queue_duration_s":0.936998,"scheduling_latency_s":0.937017,"redis_calls":13,"redis_duration_s":0.002845,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015999,"completed_at":"2026-08-20T05:57:33.183Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.869711] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.185Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"924a7f6fcaec2d1a42b05b73","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-924a7f6fcaec2d1a42b05b73: start","job_status":"start","queue_duration_s":0.954399,"scheduling_latency_s":0.954416} gitlab # [ 253.882304] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"924a7f6fcaec2d1a42b05b73","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-924a7f6fcaec2d1a42b05b73: done: 0.015477 sec","job_status":"done","queue_duration_s":0.954399,"scheduling_latency_s":0.954416,"redis_calls":13,"redis_duration_s":0.002916,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009502,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015477,"completed_at":"2026-08-20T05:57:33.200Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.922553] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"581be4aec22eb626d9f5bf71","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-581be4aec22eb626d9f5bf71: start","job_status":"start","queue_duration_s":0.97126,"scheduling_latency_s":0.971278} gitlab # [ 253.935291] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"581be4aec22eb626d9f5bf71","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-581be4aec22eb626d9f5bf71: done: 0.015597 sec","job_status":"done","queue_duration_s":0.97126,"scheduling_latency_s":0.971278,"redis_calls":13,"redis_duration_s":0.002805,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001875,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0096,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015597,"completed_at":"2026-08-20T05:57:33.217Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 253.975918] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd231436e93f7f382ff180d8","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd231436e93f7f382ff180d8: start","job_status":"start","queue_duration_s":0.988181,"scheduling_latency_s":0.988199} gitlab # [ 253.988950] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd231436e93f7f382ff180d8","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd231436e93f7f382ff180d8: done: 0.01556 sec","job_status":"done","queue_duration_s":0.988181,"scheduling_latency_s":0.988199,"redis_calls":13,"redis_duration_s":0.002746,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000926,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00182,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01556,"completed_at":"2026-08-20T05:57:33.234Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.028468] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.236Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"699f5e4407e260bdde9e1b76","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-699f5e4407e260bdde9e1b76: start","job_status":"start","queue_duration_s":1.005289,"scheduling_latency_s":1.005307} gitlab # [ 254.042479] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"699f5e4407e260bdde9e1b76","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-699f5e4407e260bdde9e1b76: done: 0.016372 sec","job_status":"done","queue_duration_s":1.005289,"scheduling_latency_s":1.005307,"redis_calls":13,"redis_duration_s":0.0032719999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001485,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001787,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016372,"completed_at":"2026-08-20T05:57:33.252Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.082372] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.254Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"788ce9c9308db09d17068d59","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-788ce9c9308db09d17068d59: start","job_status":"start","queue_duration_s":1.023244,"scheduling_latency_s":1.023263} gitlab # [ 254.095065] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"788ce9c9308db09d17068d59","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-788ce9c9308db09d17068d59: done: 0.016043 sec","job_status":"done","queue_duration_s":1.023244,"scheduling_latency_s":1.023263,"redis_calls":13,"redis_duration_s":0.00277,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010322,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016043,"completed_at":"2026-08-20T05:57:33.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.134561] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"127df9d8cca2cb07ced08c06","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-127df9d8cca2cb07ced08c06: start","job_status":"start","queue_duration_s":1.040994,"scheduling_latency_s":1.041013} gitlab # [ 254.147193] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"127df9d8cca2cb07ced08c06","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-127df9d8cca2cb07ced08c06: done: 0.015583 sec","job_status":"done","queue_duration_s":1.040994,"scheduling_latency_s":1.041013,"redis_calls":13,"redis_duration_s":0.002671,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009718,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015583,"completed_at":"2026-08-20T05:57:33.287Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.188041] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.289Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"528a5c0a91399f8e48923d80","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-528a5c0a91399f8e48923d80: start","job_status":"start","queue_duration_s":1.058027,"scheduling_latency_s":1.058046} gitlab # [ 254.200516] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"528a5c0a91399f8e48923d80","created_at":"2026-08-20T05:57:32.066Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-ff1d38ccb0a64f89","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"fcf20ad2ef2e327116165a037bc86676","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.230Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-528a5c0a91399f8e48923d80: done: 0.015385 sec","job_status":"done","queue_duration_s":1.058027,"scheduling_latency_s":1.058046,"redis_calls":13,"redis_duration_s":0.0026680000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015385,"completed_at":"2026-08-20T05:57:33.304Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.241917] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.306Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0c8469dc38a938683f6274fb","created_at":"2026-08-20T05:57:32.356Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6fc409d5751843ed","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8a2f68866e8efbd5adaee5af5cd2dcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.377Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0c8469dc38a938683f6274fb: start","job_status":"start","queue_duration_s":0.929445,"scheduling_latency_s":0.929494} gitlab # [ 254.254713] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.346Z","message":"No existing merge request to be cleaned up."} gitlab # [ 254.256478] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.379Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0c8469dc38a938683f6274fb","created_at":"2026-08-20T05:57:32.356Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6fc409d5751843ed","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8a2f68866e8efbd5adaee5af5cd2dcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.377Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0c8469dc38a938683f6274fb: done: 0.072772 sec","job_status":"done","queue_duration_s":0.929445,"scheduling_latency_s":0.929494,"redis_calls":13,"redis_duration_s":0.004703,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000582,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001785,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002336,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00079082,"duration_s":0.072772,"completed_at":"2026-08-20T05:57:33.379Z","load_balancing_strategy":"primary","db_duration_s":0.006175,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.296985] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.382Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1677dfa9536883d6cdec837a","created_at":"2026-08-20T05:57:32.356Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6fc409d5751843ed","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8a2f68866e8efbd5adaee5af5cd2dcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.377Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1677dfa9536883d6cdec837a: start","job_status":"start","queue_duration_s":1.005208,"scheduling_latency_s":1.005249} gitlab # [ 254.309635] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.405Z","message":"No existing merge request to be cleaned up."} gitlab # [ 254.311353] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.422Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1677dfa9536883d6cdec837a","created_at":"2026-08-20T05:57:32.356Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6fc409d5751843ed","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8a2f68866e8efbd5adaee5af5cd2dcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.377Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1677dfa9536883d6cdec837a: done: 0.040481 sec","job_status":"done","queue_duration_s":1.005208,"scheduling_latency_s":1.005249,"redis_calls":10,"redis_duration_s":0.003554,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002019,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040481,"completed_at":"2026-08-20T05:57:33.422Z","load_balancing_strategy":"primary","db_duration_s":0.003238,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.350914] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.425Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1ecdaf9c02396bb6771153a0","created_at":"2026-08-20T05:57:32.356Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6fc409d5751843ed","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8a2f68866e8efbd5adaee5af5cd2dcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.377Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1ecdaf9c02396bb6771153a0: start","job_status":"start","queue_duration_s":1.048116,"scheduling_latency_s":1.04815} gitlab # [ 254.363296] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.445Z","message":"No existing merge request to be cleaned up."} gitlab # [ 254.365048] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.461Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1ecdaf9c02396bb6771153a0","created_at":"2026-08-20T05:57:32.356Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6fc409d5751843ed","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8a2f68866e8efbd5adaee5af5cd2dcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.377Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1ecdaf9c02396bb6771153a0: done: 0.035689 sec","job_status":"done","queue_duration_s":1.048116,"scheduling_latency_s":1.04815,"redis_calls":10,"redis_duration_s":0.0032069999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001276,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001931,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024171,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035689,"completed_at":"2026-08-20T05:57:33.460Z","load_balancing_strategy":"primary","db_duration_s":0.003176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 254.404671] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.463Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a182f2f7a5a6c82206684bcb","created_at":"2026-08-20T05:57:32.356Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6fc409d5751843ed","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8a2f68866e8efbd5adaee5af5cd2dcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.377Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a182f2f7a5a6c82206684bcb: start","job_status":"start","queue_duration_s":1.086235,"scheduling_latency_s":1.086268} gitlab # [ 254.416836] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.481Z","message":"No existing merge request to be cleaned up."} gitlab # [ 254.418487] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:57:33.494Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a182f2f7a5a6c82206684bcb","created_at":"2026-08-20T05:57:32.356Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6fc409d5751843ed","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"b8a2f68866e8efbd5adaee5af5cd2dcf","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:57:32.377Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a182f2f7a5a6c82206684bcb: done: 0.030924 sec","job_status":"done","queue_duration_s":1.086235,"scheduling_latency_s":1.086268,"redis_calls":10,"redis_duration_s":0.003111,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001312,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001799,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020572,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030924,"completed_at":"2026-08-20T05:57:33.494Z","load_balancing_strategy":"primary","db_duration_s":0.002871,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.672502] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:01.536Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"653d4d414f55be5c0b7c5e76","created_at":"2026-08-20T05:58:01.514Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d3c5f997cc910ff8ccde2bcb1a07607","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.533Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-653d4d414f55be5c0b7c5e76: start","job_status":"start","queue_duration_s":0.00374,"scheduling_latency_s":0.003808} gitlab # [ 280.817059] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:01.684Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab # [ 280.879218] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:01.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"653d4d414f55be5c0b7c5e76","created_at":"2026-08-20T05:58:01.514Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d3c5f997cc910ff8ccde2bcb1a07607","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.533Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-653d4d414f55be5c0b7c5e76: done: 0.208716 sec","job_status":"done","queue_duration_s":0.00374,"scheduling_latency_s":0.003808,"redis_calls":8,"redis_duration_s":0.052286000000000006,"redis_read_bytes":133,"redis_write_bytes":890,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001011,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":64,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.048897,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002378,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.208716,"completed_at":"2026-08-20T05:58:01.745Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 280.962332] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:01.753Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"fca68b0d17ae78ae41ebbe39","created_at":"2026-08-20T05:58:01.610Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae92dd9d9a7c201b5147bdbd98f3e041","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.617Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-fca68b0d17ae78ae41ebbe39: start","job_status":"start","queue_duration_s":0.136282,"scheduling_latency_s":0.136347} gitlab # [ 281.989522] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:02.855Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"fca68b0d17ae78ae41ebbe39","created_at":"2026-08-20T05:58:01.610Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae92dd9d9a7c201b5147bdbd98f3e041","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.617Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-fca68b0d17ae78ae41ebbe39: done: 1.101301 sec","job_status":"done","queue_duration_s":0.136282,"scheduling_latency_s":0.136347,"redis_calls":11,"redis_duration_s":0.018212,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004909,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.01074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002563,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.282,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.282,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.52512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00240274,"exclusive_lock_hold_duration_s":1.01204004,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":1.101301,"completed_at":"2026-08-20T05:58:02.854Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.578379,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 281.993394] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:02.858Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"542dbe08903b249df42bdc62","created_at":"2026-08-20T05:58:01.626Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce49ff2c93c88a12b7f04d0a1367e382","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.632Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-542dbe08903b249df42bdc62: start","job_status":"start","queue_duration_s":1.2258,"scheduling_latency_s":1.22586} gitlab # [ 282.166112] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"542dbe08903b249df42bdc62","created_at":"2026-08-20T05:58:01.626Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ce49ff2c93c88a12b7f04d0a1367e382","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.632Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-542dbe08903b249df42bdc62: done: 0.173994 sec","job_status":"done","queue_duration_s":1.2258,"scheduling_latency_s":1.22586,"redis_calls":9,"redis_duration_s":0.010293,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001763,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00853,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.018,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0010696,"exclusive_lock_hold_duration_s":0.02230038,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.173994,"completed_at":"2026-08-20T05:58:03.032Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.01894,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.231803] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.035Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4bc209988c0f94651c5f7734","created_at":"2026-08-20T05:58:01.673Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44a4895f84b0126eebe651a573f79169","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.688Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4bc209988c0f94651c5f7734: start","job_status":"start","queue_duration_s":1.346786,"scheduling_latency_s":1.346823} gitlab # [ 282.247566] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.072Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"4bc209988c0f94651c5f7734","created_at":"2026-08-20T05:58:01.673Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"44a4895f84b0126eebe651a573f79169","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.688Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-4bc209988c0f94651c5f7734: done: 0.037633 sec","job_status":"done","queue_duration_s":1.346786,"scheduling_latency_s":1.346823,"redis_calls":7,"redis_duration_s":0.002029,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001467,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000562,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022512,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037633,"completed_at":"2026-08-20T05:58:03.072Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006249,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.288663] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.075Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c5a54b98568100b3dfa985fa","created_at":"2026-08-20T05:58:01.732Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f7aa8deda36e671fe47f91e59ce060c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.741Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c5a54b98568100b3dfa985fa: start","job_status":"start","queue_duration_s":1.333453,"scheduling_latency_s":1.333486} gitlab # [ 282.303467] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.089Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 282.307453] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.096Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c5a54b98568100b3dfa985fa","created_at":"2026-08-20T05:58:01.732Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f7aa8deda36e671fe47f91e59ce060c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.741Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c5a54b98568100b3dfa985fa: done: 0.021636 sec","job_status":"done","queue_duration_s":1.333453,"scheduling_latency_s":1.333486,"redis_calls":7,"redis_duration_s":0.001438,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001046,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000392,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.021636,"completed_at":"2026-08-20T05:58:03.096Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.349834] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.099Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4b9586f4ac3b7f211b53f400","created_at":"2026-08-20T05:58:01.767Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a2f13f07638d9167ee132225bbbee10","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.794Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4b9586f4ac3b7f211b53f400: start","job_status":"start","queue_duration_s":1.305272,"scheduling_latency_s":1.305297} gitlab # [ 282.363486] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.126Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"4b9586f4ac3b7f211b53f400","created_at":"2026-08-20T05:58:01.767Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1a2f13f07638d9167ee132225bbbee10","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.794Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-4b9586f4ac3b7f211b53f400: done: 0.026885 sec","job_status":"done","queue_duration_s":1.305272,"scheduling_latency_s":1.305297,"redis_calls":12,"redis_duration_s":0.00213,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.00051,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000348,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000357,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033992,"duration_s":0.026885,"completed_at":"2026-08-20T05:58:03.126Z","load_balancing_strategy":"primary","db_duration_s":0.000819,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.409041] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.128Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"1a2c27b78a5a1193435193c4","created_at":"2026-08-20T05:58:01.816Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ab42c15d1d07932aae2d834d9bff638","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.827Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-1a2c27b78a5a1193435193c4: start","job_status":"start","queue_duration_s":1.300343,"scheduling_latency_s":1.300366} gitlab # [ 282.423162] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.150Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"1a2c27b78a5a1193435193c4","created_at":"2026-08-20T05:58:01.816Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ab42c15d1d07932aae2d834d9bff638","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.827Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-1a2c27b78a5a1193435193c4: done: 0.022454 sec","job_status":"done","queue_duration_s":1.300343,"scheduling_latency_s":1.300366,"redis_calls":9,"redis_duration_s":0.001585,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000733,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058744,"exclusive_lock_hold_duration_s":0.00480528,"duration_s":0.022454,"completed_at":"2026-08-20T05:58:03.150Z","load_balancing_strategy":"primary","db_duration_s":0.001825,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.465180] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.151Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9fe61b4cb1e03c1dff2820dd","created_at":"2026-08-20T05:58:01.864Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea3b0c03cede056825fd186fe4128b6b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.871Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9fe61b4cb1e03c1dff2820dd: start","job_status":"start","queue_duration_s":1.280275,"scheduling_latency_s":1.280298} gitlab # [ 282.481725] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.169Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"9fe61b4cb1e03c1dff2820dd","created_at":"2026-08-20T05:58:01.864Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ea3b0c03cede056825fd186fe4128b6b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.871Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-9fe61b4cb1e03c1dff2820dd: done: 0.017692 sec","job_status":"done","queue_duration_s":1.280275,"scheduling_latency_s":1.280298,"redis_calls":8,"redis_duration_s":0.001569,"redis_read_bytes":133,"redis_write_bytes":901,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00015,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001106,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000313,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017692,"completed_at":"2026-08-20T05:58:03.169Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.525904] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.170Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d1615e3db65920e06ee66a09","created_at":"2026-08-20T05:58:01.889Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c801a51cf28c621dc20e424d9f3b6b38","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.894Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d1615e3db65920e06ee66a09: start","job_status":"start","queue_duration_s":1.276235,"scheduling_latency_s":1.276256} gitlab # [ 282.541014] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.180Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 282.544270] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.185Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"d1615e3db65920e06ee66a09","created_at":"2026-08-20T05:58:01.889Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c801a51cf28c621dc20e424d9f3b6b38","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.894Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-d1615e3db65920e06ee66a09: done: 0.014686 sec","job_status":"done","queue_duration_s":1.276235,"scheduling_latency_s":1.276256,"redis_calls":7,"redis_duration_s":0.001038,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000297,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009828,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014686,"completed_at":"2026-08-20T05:58:03.185Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.586712] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.186Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9b625ee88ce94ae8ad024e10","created_at":"2026-08-20T05:58:01.903Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1e2c0f3539fef5522bae35ac49d8c0f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:58:01.914Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9b625ee88ce94ae8ad024e10: start","job_status":"start","queue_duration_s":1.271705,"scheduling_latency_s":1.271723} gitlab # [ 282.601803] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.209Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9b625ee88ce94ae8ad024e10","created_at":"2026-08-20T05:58:01.903Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f1e2c0f3539fef5522bae35ac49d8c0f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T05:58:01.914Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9b625ee88ce94ae8ad024e10: done: 0.023051 sec","job_status":"done","queue_duration_s":1.271705,"scheduling_latency_s":1.271723,"redis_calls":7,"redis_duration_s":0.000978,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000248,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023051,"completed_at":"2026-08-20T05:58:03.209Z","load_balancing_strategy":"primary","db_duration_s":0.002915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.643053] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.211Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e9475dd88238012fb5a70888","created_at":"2026-08-20T05:58:01.923Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5947e2631afcf5b8833e4f8ddcc6424c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.928Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e9475dd88238012fb5a70888: start","job_status":"start","queue_duration_s":1.28311,"scheduling_latency_s":1.283129} gitlab # [ 282.658306] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.229Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"e9475dd88238012fb5a70888","created_at":"2026-08-20T05:58:01.923Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5947e2631afcf5b8833e4f8ddcc6424c","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:01.928Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-e9475dd88238012fb5a70888: done: 0.01791 sec","job_status":"done","queue_duration_s":1.28311,"scheduling_latency_s":1.283129,"redis_calls":9,"redis_duration_s":0.002045,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001415,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00063,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011375,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00047358,"exclusive_lock_hold_duration_s":0.0040069,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.01791,"completed_at":"2026-08-20T05:58:03.229Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002035,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.702916] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.230Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a8bf66e3cc96578e8d981119","created_at":"2026-08-20T05:58:01.933Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e9843deb496d1cbd204a710d1390322","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:58:01.938Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a8bf66e3cc96578e8d981119: start","job_status":"start","queue_duration_s":1.292287,"scheduling_latency_s":1.292305} gitlab # [ 282.716777] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.237Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 282.720564] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.243Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"a8bf66e3cc96578e8d981119","created_at":"2026-08-20T05:58:01.933Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5e9843deb496d1cbd204a710d1390322","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T05:58:01.938Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-a8bf66e3cc96578e8d981119: done: 0.013275 sec","job_status":"done","queue_duration_s":1.292287,"scheduling_latency_s":1.292305,"redis_calls":7,"redis_duration_s":0.0009760000000000001,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000689,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000287,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008764,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013275,"completed_at":"2026-08-20T05:58:03.243Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.761661] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.245Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"e2aa8e2136e24cb4447abf53","created_at":"2026-08-20T05:58:01.952Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58a8d46fe69d776e8ec45d69906cfde8","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.039Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-e2aa8e2136e24cb4447abf53: start","job_status":"start","queue_duration_s":1.205734,"scheduling_latency_s":1.205752} gitlab # [ 282.776931] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.278Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"e2aa8e2136e24cb4447abf53","created_at":"2026-08-20T05:58:01.952Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"58a8d46fe69d776e8ec45d69906cfde8","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.039Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-e2aa8e2136e24cb4447abf53: done: 0.033226 sec","job_status":"done","queue_duration_s":1.205734,"scheduling_latency_s":1.205752,"redis_calls":10,"redis_duration_s":0.002193,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000299,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001595,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000299,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024172,"duration_s":0.033226,"completed_at":"2026-08-20T05:58:03.278Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005951,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.821959] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2125e32768eae6d01786c340","created_at":"2026-08-20T05:58:02.061Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98e9020449401146eefa784317d2b5e4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.065Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2125e32768eae6d01786c340: start","job_status":"start","queue_duration_s":1.214248,"scheduling_latency_s":1.21427} gitlab # [ 282.837515] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.293Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"2125e32768eae6d01786c340","created_at":"2026-08-20T05:58:02.061Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"98e9020449401146eefa784317d2b5e4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.065Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-2125e32768eae6d01786c340: done: 0.013367 sec","job_status":"done","queue_duration_s":1.214248,"scheduling_latency_s":1.21427,"redis_calls":7,"redis_duration_s":0.000969,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000274,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008624,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013367,"completed_at":"2026-08-20T05:58:03.293Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.880679] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.294Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"61449bff3cfe6f412f74dfd6","created_at":"2026-08-20T05:58:02.100Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f54bd7a7b42b5a63b34c6ffdfa1da14","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.103Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-61449bff3cfe6f412f74dfd6: start","job_status":"start","queue_duration_s":1.190865,"scheduling_latency_s":1.190885} gitlab # [ 282.895620] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"61449bff3cfe6f412f74dfd6","created_at":"2026-08-20T05:58:02.100Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f54bd7a7b42b5a63b34c6ffdfa1da14","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.103Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-61449bff3cfe6f412f74dfd6: done: 0.318058 sec","job_status":"done","queue_duration_s":1.190865,"scheduling_latency_s":1.190885,"redis_calls":562,"redis_duration_s":0.056361,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000765,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.055596,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.295091,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.318058,"completed_at":"2026-08-20T05:58:03.612Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.938609] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.613Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"4e6d206839b01ccaa3a1392a","created_at":"2026-08-20T05:58:02.121Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a560090a8f629ea97c0479567a77586c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:58:02.124Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-4e6d206839b01ccaa3a1392a: start","job_status":"start","queue_duration_s":1.48884,"scheduling_latency_s":1.488872} gitlab # [ 282.952853] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.622Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 282.956317] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.628Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"4e6d206839b01ccaa3a1392a","created_at":"2026-08-20T05:58:02.121Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a560090a8f629ea97c0479567a77586c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T05:58:02.124Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-4e6d206839b01ccaa3a1392a: done: 0.014801 sec","job_status":"done","queue_duration_s":1.48884,"scheduling_latency_s":1.488872,"redis_calls":7,"redis_duration_s":0.0010149999999999998,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000725,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008643,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014801,"completed_at":"2026-08-20T05:58:03.628Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 282.997767] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.630Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"41eac2188a8a464f643f2147","created_at":"2026-08-20T05:58:02.149Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89943b11ca4fa2ddf71f6572f79b63e5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.156Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-41eac2188a8a464f643f2147: start","job_status":"start","queue_duration_s":1.473734,"scheduling_latency_s":1.473758} gitlab # [ 283.014208] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.654Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"41eac2188a8a464f643f2147","created_at":"2026-08-20T05:58:02.149Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"89943b11ca4fa2ddf71f6572f79b63e5","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.156Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-41eac2188a8a464f643f2147: done: 0.024214 sec","job_status":"done","queue_duration_s":1.473734,"scheduling_latency_s":1.473758,"redis_calls":10,"redis_duration_s":0.0022459999999999997,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00156,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000686,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00711838,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.024214,"completed_at":"2026-08-20T05:58:03.654Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004019,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 283.058946] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.656Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"4caa43b64a0e5a0c5acdb333","created_at":"2026-08-20T05:58:02.194Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfaa069506fc34a7f628a0682022d3d8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.199Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-4caa43b64a0e5a0c5acdb333: start","job_status":"start","queue_duration_s":1.456971,"scheduling_latency_s":1.456992} gitlab # [ 283.073610] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.672Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"4caa43b64a0e5a0c5acdb333","created_at":"2026-08-20T05:58:02.194Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cfaa069506fc34a7f628a0682022d3d8","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.199Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-4caa43b64a0e5a0c5acdb333: done: 0.01672 sec","job_status":"done","queue_duration_s":1.456971,"scheduling_latency_s":1.456992,"redis_calls":7,"redis_duration_s":0.0016950000000000001,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001443,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000252,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010469,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01672,"completed_at":"2026-08-20T05:58:03.672Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001548,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.115098] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.673Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7e6618fc1d2f4f2d1d5985dc","created_at":"2026-08-20T05:58:02.279Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9d53790ce6a8a1d82b1db5baf362d06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.285Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7e6618fc1d2f4f2d1d5985dc: start","job_status":"start","queue_duration_s":1.388904,"scheduling_latency_s":1.388923} gitlab # [ 283.130851] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.760Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"7e6618fc1d2f4f2d1d5985dc","created_at":"2026-08-20T05:58:02.279Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f9d53790ce6a8a1d82b1db5baf362d06","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.285Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-7e6618fc1d2f4f2d1d5985dc: done: 0.086257 sec","job_status":"done","queue_duration_s":1.388904,"scheduling_latency_s":1.388923,"redis_calls":9,"redis_duration_s":0.001634,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000817,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000817,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.031,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051118,"exclusive_lock_hold_duration_s":0.06900044,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.086257,"completed_at":"2026-08-20T05:58:03.760Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.060707,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.175648] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.762Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"24db64211b6bad8b89464825","created_at":"2026-08-20T05:58:02.325Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5cb9f072fc80b37423ce730c0193609","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.342Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-24db64211b6bad8b89464825: start","job_status":"start","queue_duration_s":1.419292,"scheduling_latency_s":1.41932} gitlab # [ 283.190691] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.773Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 283.195007] setup-gitlab-start[3031]: W, [2026-08-20T05:58:03.985287 #3031] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 283.197269] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.779Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"24db64211b6bad8b89464825","created_at":"2026-08-20T05:58:02.325Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d5cb9f072fc80b37423ce730c0193609","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.342Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-24db64211b6bad8b89464825: done: 0.017926 sec","job_status":"done","queue_duration_s":1.419292,"scheduling_latency_s":1.41932,"redis_calls":7,"redis_duration_s":0.001204,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000856,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000348,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017926,"completed_at":"2026-08-20T05:58:03.779Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.240289] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.781Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"8b2b11e62b8ab6d985724000","created_at":"2026-08-20T05:58:02.370Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df2137c50ebe09a0fbce1e65f3316e5c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.405Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-8b2b11e62b8ab6d985724000: start","job_status":"start","queue_duration_s":1.376166,"scheduling_latency_s":1.376188} gitlab # [ 283.255922] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.813Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"8b2b11e62b8ab6d985724000","created_at":"2026-08-20T05:58:02.370Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df2137c50ebe09a0fbce1e65f3316e5c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.405Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-8b2b11e62b8ab6d985724000: done: 0.031932 sec","job_status":"done","queue_duration_s":1.376166,"scheduling_latency_s":1.376188,"redis_calls":13,"redis_duration_s":0.001961,"redis_read_bytes":139,"redis_write_bytes":1611,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00047,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":386,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000789,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000702,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00055104,"exclusive_lock_hold_duration_s":0.00878926,"duration_s":0.031932,"completed_at":"2026-08-20T05:58:03.813Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004669,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.301738] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.814Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"881cc9593884b01e1e605d76","created_at":"2026-08-20T05:58:02.437Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.452Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-881cc9593884b01e1e605d76: start","job_status":"start","queue_duration_s":1.362097,"scheduling_latency_s":1.36212} gitlab # [ 283.316677] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.915Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"881cc9593884b01e1e605d76","created_at":"2026-08-20T05:58:02.437Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.452Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-881cc9593884b01e1e605d76: done: 0.100639 sec","job_status":"done","queue_duration_s":1.362097,"scheduling_latency_s":1.36212,"redis_calls":60,"redis_duration_s":0.009082,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000614,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.008042,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000426,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.100639,"completed_at":"2026-08-20T05:58:03.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.359877] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.916Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d407b21385427a7b3b0d533c","created_at":"2026-08-20T05:58:02.595Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8dd76b1b100be39dfe188440fd50d5d3","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.611Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d407b21385427a7b3b0d533c: start","job_status":"start","queue_duration_s":1.304595,"scheduling_latency_s":1.30462} gitlab # [ 283.375056] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.948Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"d407b21385427a7b3b0d533c","created_at":"2026-08-20T05:58:02.595Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8dd76b1b100be39dfe188440fd50d5d3","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.611Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-d407b21385427a7b3b0d533c: done: 0.032483 sec","job_status":"done","queue_duration_s":1.304595,"scheduling_latency_s":1.30462,"redis_calls":7,"redis_duration_s":0.001686,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00142,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.032483,"completed_at":"2026-08-20T05:58:03.948Z","load_balancing_strategy":"primary","db_duration_s":0.016924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.420366] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.950Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"99b913ff73005ae8e4293c8a","created_at":"2026-08-20T05:58:02.638Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"252fd43af7e601209cb33e4420ffb02d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.653Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-99b913ff73005ae8e4293c8a: start","job_status":"start","queue_duration_s":1.296803,"scheduling_latency_s":1.296825} gitlab # [ 283.434699] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.979Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"99b913ff73005ae8e4293c8a","created_at":"2026-08-20T05:58:02.638Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-3402f794a01a467e","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"252fd43af7e601209cb33e4420ffb02d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-08-20T05:58:02.653Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-99b913ff73005ae8e4293c8a: done: 0.029707 sec","job_status":"done","queue_duration_s":1.296803,"scheduling_latency_s":1.296825,"redis_calls":14,"redis_duration_s":0.003065,"redis_read_bytes":16,"redis_write_bytes":4022,"redis_queues_calls":2,"redis_queues_duration_s":0.000211,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3011,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002271,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000583,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.029707,"completed_at":"2026-08-20T05:58:03.979Z","load_balancing_strategy":"primary","db_duration_s":0.002017,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.477995] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.981Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb2ef913ad7d54ad72911353","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb2ef913ad7d54ad72911353: start","job_status":"start","queue_duration_s":0.073731,"scheduling_latency_s":0.073752} gitlab # [ 283.491553] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eb2ef913ad7d54ad72911353","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eb2ef913ad7d54ad72911353: done: 0.01542 sec","job_status":"done","queue_duration_s":0.073731,"scheduling_latency_s":0.073752,"redis_calls":13,"redis_duration_s":0.00148,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01542,"completed_at":"2026-08-20T05:58:03.996Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.533106] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:03.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3871c0dbd6f412bd200ab8a","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3871c0dbd6f412bd200ab8a: start","job_status":"start","queue_duration_s":0.09037,"scheduling_latency_s":0.09039} gitlab # [ 283.546128] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b3871c0dbd6f412bd200ab8a","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b3871c0dbd6f412bd200ab8a: done: 0.015141 sec","job_status":"done","queue_duration_s":0.09037,"scheduling_latency_s":0.09039,"redis_calls":13,"redis_duration_s":0.001475,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010036,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015141,"completed_at":"2026-08-20T05:58:04.012Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.586963] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e929141c11155cedc07e253f","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e929141c11155cedc07e253f: start","job_status":"start","queue_duration_s":0.106911,"scheduling_latency_s":0.10693} gitlab # [ 283.600173] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.029Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e929141c11155cedc07e253f","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e929141c11155cedc07e253f: done: 0.015572 sec","job_status":"done","queue_duration_s":0.106911,"scheduling_latency_s":0.10693,"redis_calls":13,"redis_duration_s":0.0015500000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000613,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015572,"completed_at":"2026-08-20T05:58:04.029Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.641724] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6bf9d8152be469882b21dbd","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6bf9d8152be469882b21dbd: start","job_status":"start","queue_duration_s":0.123651,"scheduling_latency_s":0.12367} gitlab # [ 283.654438] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.046Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e6bf9d8152be469882b21dbd","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e6bf9d8152be469882b21dbd: done: 0.015177 sec","job_status":"done","queue_duration_s":0.123651,"scheduling_latency_s":0.12367,"redis_calls":13,"redis_duration_s":0.0015440000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000532,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015177,"completed_at":"2026-08-20T05:58:04.046Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.695341] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.047Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95a94250e8cd7da222d863e5","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95a94250e8cd7da222d863e5: start","job_status":"start","queue_duration_s":0.140052,"scheduling_latency_s":0.140072} gitlab # [ 283.708337] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"95a94250e8cd7da222d863e5","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-95a94250e8cd7da222d863e5: done: 0.014905 sec","job_status":"done","queue_duration_s":0.140052,"scheduling_latency_s":0.140072,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014905,"completed_at":"2026-08-20T05:58:04.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.749368] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.065Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1283f033237102c2989105a1","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1283f033237102c2989105a1: start","job_status":"start","queue_duration_s":0.158123,"scheduling_latency_s":0.158143} gitlab # [ 283.762222] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.080Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1283f033237102c2989105a1","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1283f033237102c2989105a1: done: 0.015268 sec","job_status":"done","queue_duration_s":0.158123,"scheduling_latency_s":0.158143,"redis_calls":13,"redis_duration_s":0.0017079999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001184,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015268,"completed_at":"2026-08-20T05:58:04.080Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.803004] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.081Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"476cb98795961dc05c1254c4","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-476cb98795961dc05c1254c4: start","job_status":"start","queue_duration_s":0.17447,"scheduling_latency_s":0.174489} gitlab # [ 283.815856] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.096Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"476cb98795961dc05c1254c4","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-476cb98795961dc05c1254c4: done: 0.015028 sec","job_status":"done","queue_duration_s":0.17447,"scheduling_latency_s":0.174489,"redis_calls":13,"redis_duration_s":0.0014759999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000566,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010418,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015028,"completed_at":"2026-08-20T05:58:04.096Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.857997] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d877a9ad5f45e5bb46e832d","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d877a9ad5f45e5bb46e832d: start","job_status":"start","queue_duration_s":0.190629,"scheduling_latency_s":0.190649} gitlab # [ 283.871036] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d877a9ad5f45e5bb46e832d","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d877a9ad5f45e5bb46e832d: done: 0.014892 sec","job_status":"done","queue_duration_s":0.190629,"scheduling_latency_s":0.190649,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010238,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014892,"completed_at":"2026-08-20T05:58:04.112Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.912192] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"860381d0d4eeee14ac0037cd","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-860381d0d4eeee14ac0037cd: start","job_status":"start","queue_duration_s":0.206761,"scheduling_latency_s":0.206783} gitlab # [ 283.924959] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"860381d0d4eeee14ac0037cd","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-860381d0d4eeee14ac0037cd: done: 0.01507 sec","job_status":"done","queue_duration_s":0.206761,"scheduling_latency_s":0.206783,"redis_calls":13,"redis_duration_s":0.0015249999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000966,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01507,"completed_at":"2026-08-20T05:58:04.129Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 283.966041] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"942f3e47d04dcc849ecb5bc5","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-942f3e47d04dcc849ecb5bc5: start","job_status":"start","queue_duration_s":0.223291,"scheduling_latency_s":0.22331} gitlab # [ 283.978807] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"942f3e47d04dcc849ecb5bc5","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-942f3e47d04dcc849ecb5bc5: done: 0.014318 sec","job_status":"done","queue_duration_s":0.223291,"scheduling_latency_s":0.22331,"redis_calls":13,"redis_duration_s":0.001354,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000498,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000856,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009862,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014318,"completed_at":"2026-08-20T05:58:04.144Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.020161] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad9b52451cf7e6ca6520597a","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad9b52451cf7e6ca6520597a: start","job_status":"start","queue_duration_s":0.238672,"scheduling_latency_s":0.23869} gitlab # [ 284.033948] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ad9b52451cf7e6ca6520597a","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ad9b52451cf7e6ca6520597a: done: 0.014238 sec","job_status":"done","queue_duration_s":0.238672,"scheduling_latency_s":0.23869,"redis_calls":13,"redis_duration_s":0.001374,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014238,"completed_at":"2026-08-20T05:58:04.160Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.075176] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a70ea203796205233080fea1","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a70ea203796205233080fea1: start","job_status":"start","queue_duration_s":0.253999,"scheduling_latency_s":0.254018} gitlab # [ 284.088427] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a70ea203796205233080fea1","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a70ea203796205233080fea1: done: 0.015145 sec","job_status":"done","queue_duration_s":0.253999,"scheduling_latency_s":0.254018,"redis_calls":13,"redis_duration_s":0.00169,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001167,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009729,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015145,"completed_at":"2026-08-20T05:58:04.176Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.129050] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fff15dd76ce5a8d2058d213","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fff15dd76ce5a8d2058d213: start","job_status":"start","queue_duration_s":0.270249,"scheduling_latency_s":0.270268} gitlab # [ 284.141985] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4fff15dd76ce5a8d2058d213","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4fff15dd76ce5a8d2058d213: done: 0.014841 sec","job_status":"done","queue_duration_s":0.270249,"scheduling_latency_s":0.270268,"redis_calls":13,"redis_duration_s":0.001484,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00057,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014841,"completed_at":"2026-08-20T05:58:04.192Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.182632] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c06569077416624328ad9850","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c06569077416624328ad9850: start","job_status":"start","queue_duration_s":0.286155,"scheduling_latency_s":0.286173} gitlab # [ 284.196065] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c06569077416624328ad9850","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c06569077416624328ad9850: done: 0.014439 sec","job_status":"done","queue_duration_s":0.286155,"scheduling_latency_s":0.286173,"redis_calls":13,"redis_duration_s":0.0014429999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014439,"completed_at":"2026-08-20T05:58:04.207Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.239310] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83eff6958bfbbe4981bbdb55","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83eff6958bfbbe4981bbdb55: start","job_status":"start","queue_duration_s":0.301698,"scheduling_latency_s":0.301717} gitlab # [ 284.252625] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83eff6958bfbbe4981bbdb55","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83eff6958bfbbe4981bbdb55: done: 0.014527 sec","job_status":"done","queue_duration_s":0.301698,"scheduling_latency_s":0.301717,"redis_calls":13,"redis_duration_s":0.001435,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010093,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014527,"completed_at":"2026-08-20T05:58:04.223Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.294015] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a85e49077c28d3bdcfdd5dd1","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a85e49077c28d3bdcfdd5dd1: start","job_status":"start","queue_duration_s":0.317381,"scheduling_latency_s":0.317401} gitlab # [ 284.307144] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a85e49077c28d3bdcfdd5dd1","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a85e49077c28d3bdcfdd5dd1: done: 0.015071 sec","job_status":"done","queue_duration_s":0.317381,"scheduling_latency_s":0.317401,"redis_calls":13,"redis_duration_s":0.001456,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000535,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015071,"completed_at":"2026-08-20T05:58:04.239Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.348566] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6255e69d002f7c6bb5e8b358","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6255e69d002f7c6bb5e8b358: start","job_status":"start","queue_duration_s":0.33354,"scheduling_latency_s":0.333558} gitlab # [ 284.361101] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6255e69d002f7c6bb5e8b358","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6255e69d002f7c6bb5e8b358: done: 0.014144 sec","job_status":"done","queue_duration_s":0.33354,"scheduling_latency_s":0.333558,"redis_calls":13,"redis_duration_s":0.001363,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000489,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009815,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014144,"completed_at":"2026-08-20T05:58:04.255Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.401808] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31192543a3d3efbf76902e54","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31192543a3d3efbf76902e54: start","job_status":"start","queue_duration_s":0.348763,"scheduling_latency_s":0.348781} gitlab # [ 284.414811] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31192543a3d3efbf76902e54","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31192543a3d3efbf76902e54: done: 0.014215 sec","job_status":"done","queue_duration_s":0.348763,"scheduling_latency_s":0.348781,"redis_calls":13,"redis_duration_s":0.001369,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000872,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009965,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014215,"completed_at":"2026-08-20T05:58:04.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.457479] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca8252f953d1fe5a578b56a8","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca8252f953d1fe5a578b56a8: start","job_status":"start","queue_duration_s":0.364328,"scheduling_latency_s":0.364348} gitlab # [ 284.470415] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca8252f953d1fe5a578b56a8","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca8252f953d1fe5a578b56a8: done: 0.014308 sec","job_status":"done","queue_duration_s":0.364328,"scheduling_latency_s":0.364348,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000894,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00964,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014308,"completed_at":"2026-08-20T05:58:04.285Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.511135] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2111ecd1a6166eb6cdf1087b","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2111ecd1a6166eb6cdf1087b: start","job_status":"start","queue_duration_s":0.380037,"scheduling_latency_s":0.380055} gitlab # [ 284.524269] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2111ecd1a6166eb6cdf1087b","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2111ecd1a6166eb6cdf1087b: done: 0.014395 sec","job_status":"done","queue_duration_s":0.380037,"scheduling_latency_s":0.380055,"redis_calls":13,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010013,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014395,"completed_at":"2026-08-20T05:58:04.301Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.566243] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d17330eee12a4153bf9397be","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d17330eee12a4153bf9397be: start","job_status":"start","queue_duration_s":0.395526,"scheduling_latency_s":0.395544} gitlab # [ 284.579474] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d17330eee12a4153bf9397be","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d17330eee12a4153bf9397be: done: 0.014587 sec","job_status":"done","queue_duration_s":0.395526,"scheduling_latency_s":0.395544,"redis_calls":13,"redis_duration_s":0.001577,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001036,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014587,"completed_at":"2026-08-20T05:58:04.317Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.620503] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"500b3aa38fbf0fb69cbba072","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-500b3aa38fbf0fb69cbba072: start","job_status":"start","queue_duration_s":0.411174,"scheduling_latency_s":0.411193} gitlab # [ 284.633497] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"500b3aa38fbf0fb69cbba072","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-500b3aa38fbf0fb69cbba072: done: 0.014387 sec","job_status":"done","queue_duration_s":0.411174,"scheduling_latency_s":0.411193,"redis_calls":13,"redis_duration_s":0.0014329999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000529,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009972,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014387,"completed_at":"2026-08-20T05:58:04.332Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.676579] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"131ba68ac747e31fe79aafe2","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-131ba68ac747e31fe79aafe2: start","job_status":"start","queue_duration_s":0.441018,"scheduling_latency_s":0.44104} gitlab # [ 284.689621] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"131ba68ac747e31fe79aafe2","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-131ba68ac747e31fe79aafe2: done: 0.014963 sec","job_status":"done","queue_duration_s":0.441018,"scheduling_latency_s":0.44104,"redis_calls":13,"redis_duration_s":0.0014620000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000537,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014963,"completed_at":"2026-08-20T05:58:04.363Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.731061] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fe913b4afe342d885d4cea5","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fe913b4afe342d885d4cea5: start","job_status":"start","queue_duration_s":0.457383,"scheduling_latency_s":0.457402} gitlab # [ 284.744815] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9fe913b4afe342d885d4cea5","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9fe913b4afe342d885d4cea5: done: 0.014588 sec","job_status":"done","queue_duration_s":0.457383,"scheduling_latency_s":0.457402,"redis_calls":13,"redis_duration_s":0.001659,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000528,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001131,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014588,"completed_at":"2026-08-20T05:58:04.379Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.788154] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.380Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a084e359877b72865c737cb2","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a084e359877b72865c737cb2: start","job_status":"start","queue_duration_s":0.473045,"scheduling_latency_s":0.473063} gitlab # [ 284.801967] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a084e359877b72865c737cb2","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a084e359877b72865c737cb2: done: 0.014082 sec","job_status":"done","queue_duration_s":0.473045,"scheduling_latency_s":0.473063,"redis_calls":13,"redis_duration_s":0.001376,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000487,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014082,"completed_at":"2026-08-20T05:58:04.394Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.844303] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2dccca97922af5933107306","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2dccca97922af5933107306: start","job_status":"start","queue_duration_s":0.488228,"scheduling_latency_s":0.488247} gitlab # [ 284.857615] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f2dccca97922af5933107306","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f2dccca97922af5933107306: done: 0.014183 sec","job_status":"done","queue_duration_s":0.488228,"scheduling_latency_s":0.488247,"redis_calls":13,"redis_duration_s":0.001382,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014183,"completed_at":"2026-08-20T05:58:04.409Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.901635] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"688798dc7e242896a2d95bfe","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-688798dc7e242896a2d95bfe: start","job_status":"start","queue_duration_s":0.503789,"scheduling_latency_s":0.503808} gitlab # [ 284.914980] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"688798dc7e242896a2d95bfe","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-688798dc7e242896a2d95bfe: done: 0.014229 sec","job_status":"done","queue_duration_s":0.503789,"scheduling_latency_s":0.503808,"redis_calls":13,"redis_duration_s":0.001725,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009856,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014229,"completed_at":"2026-08-20T05:58:04.425Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 284.957024] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"336834835bcb0556372f07e4","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-336834835bcb0556372f07e4: start","job_status":"start","queue_duration_s":0.519061,"scheduling_latency_s":0.519079} gitlab # [ 284.970204] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"336834835bcb0556372f07e4","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-336834835bcb0556372f07e4: done: 0.01433 sec","job_status":"done","queue_duration_s":0.519061,"scheduling_latency_s":0.519079,"redis_calls":13,"redis_duration_s":0.0017170000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001211,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01433,"completed_at":"2026-08-20T05:58:04.440Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.012654] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd8429efcbc778ebadb733fe","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd8429efcbc778ebadb733fe: start","job_status":"start","queue_duration_s":0.53453,"scheduling_latency_s":0.534548} gitlab # [ 285.026349] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.456Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fd8429efcbc778ebadb733fe","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fd8429efcbc778ebadb733fe: done: 0.014468 sec","job_status":"done","queue_duration_s":0.53453,"scheduling_latency_s":0.534548,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014468,"completed_at":"2026-08-20T05:58:04.456Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.068767] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.457Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5b98a714700db96fe5c707b","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5b98a714700db96fe5c707b: start","job_status":"start","queue_duration_s":0.550399,"scheduling_latency_s":0.550418} gitlab # [ 285.082042] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5b98a714700db96fe5c707b","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5b98a714700db96fe5c707b: done: 0.014811 sec","job_status":"done","queue_duration_s":0.550399,"scheduling_latency_s":0.550418,"redis_calls":13,"redis_duration_s":0.001539,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014811,"completed_at":"2026-08-20T05:58:04.472Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.125042] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.473Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da1d94b7738341c8a55f69e3","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da1d94b7738341c8a55f69e3: start","job_status":"start","queue_duration_s":0.56654,"scheduling_latency_s":0.566559} gitlab # [ 285.138579] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.488Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da1d94b7738341c8a55f69e3","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da1d94b7738341c8a55f69e3: done: 0.014172 sec","job_status":"done","queue_duration_s":0.56654,"scheduling_latency_s":0.566559,"redis_calls":13,"redis_duration_s":0.001341,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014172,"completed_at":"2026-08-20T05:58:04.488Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.181167] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.489Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55262047811962694a5e950b","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55262047811962694a5e950b: start","job_status":"start","queue_duration_s":0.582038,"scheduling_latency_s":0.582056} gitlab # [ 285.194499] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.503Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55262047811962694a5e950b","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55262047811962694a5e950b: done: 0.014016 sec","job_status":"done","queue_duration_s":0.582038,"scheduling_latency_s":0.582056,"redis_calls":13,"redis_duration_s":0.001619,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000754,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014016,"completed_at":"2026-08-20T05:58:04.503Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.236063] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.504Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cee382419cf802eea15f9ee2","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cee382419cf802eea15f9ee2: start","job_status":"start","queue_duration_s":0.597132,"scheduling_latency_s":0.59715} gitlab # [ 285.250129] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.518Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cee382419cf802eea15f9ee2","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cee382419cf802eea15f9ee2: done: 0.014074 sec","job_status":"done","queue_duration_s":0.597132,"scheduling_latency_s":0.59715,"redis_calls":13,"redis_duration_s":0.001653,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00049,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014074,"completed_at":"2026-08-20T05:58:04.518Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.291982] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"036db60b382b0445147579c8","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-036db60b382b0445147579c8: start","job_status":"start","queue_duration_s":0.612348,"scheduling_latency_s":0.612367} gitlab # [ 285.304986] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"036db60b382b0445147579c8","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-036db60b382b0445147579c8: done: 0.014244 sec","job_status":"done","queue_duration_s":0.612348,"scheduling_latency_s":0.612367,"redis_calls":13,"redis_duration_s":0.00139,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014244,"completed_at":"2026-08-20T05:58:04.533Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.345695] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e9df4b3f3a2cea04df7b68f","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e9df4b3f3a2cea04df7b68f: start","job_status":"start","queue_duration_s":0.627961,"scheduling_latency_s":0.62798} gitlab # [ 285.358966] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e9df4b3f3a2cea04df7b68f","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e9df4b3f3a2cea04df7b68f: done: 0.014414 sec","job_status":"done","queue_duration_s":0.627961,"scheduling_latency_s":0.62798,"redis_calls":13,"redis_duration_s":0.001469,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010011,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014414,"completed_at":"2026-08-20T05:58:04.549Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.400071] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ebca7444a3cf2d07b5be3f7","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ebca7444a3cf2d07b5be3f7: start","job_status":"start","queue_duration_s":0.643458,"scheduling_latency_s":0.643477} gitlab # [ 285.412946] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1ebca7444a3cf2d07b5be3f7","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1ebca7444a3cf2d07b5be3f7: done: 0.01455 sec","job_status":"done","queue_duration_s":0.643458,"scheduling_latency_s":0.643477,"redis_calls":13,"redis_duration_s":0.001835,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01455,"completed_at":"2026-08-20T05:58:04.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.454648] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a56ae1593b0abc34a8649b62","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a56ae1593b0abc34a8649b62: start","job_status":"start","queue_duration_s":0.659077,"scheduling_latency_s":0.659096} gitlab # [ 285.467747] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a56ae1593b0abc34a8649b62","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a56ae1593b0abc34a8649b62: done: 0.015041 sec","job_status":"done","queue_duration_s":0.659077,"scheduling_latency_s":0.659096,"redis_calls":13,"redis_duration_s":0.001494,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000946,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009834,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015041,"completed_at":"2026-08-20T05:58:04.581Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.508451] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e91e5e23320af9a53c831452","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e91e5e23320af9a53c831452: start","job_status":"start","queue_duration_s":0.675496,"scheduling_latency_s":0.675515} gitlab # [ 285.521247] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.597Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e91e5e23320af9a53c831452","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e91e5e23320af9a53c831452: done: 0.014499 sec","job_status":"done","queue_duration_s":0.675496,"scheduling_latency_s":0.675515,"redis_calls":13,"redis_duration_s":0.00147,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000543,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010107,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014499,"completed_at":"2026-08-20T05:58:04.597Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.561927] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cf6302bf38574ffa43c74cc","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cf6302bf38574ffa43c74cc: start","job_status":"start","queue_duration_s":0.691104,"scheduling_latency_s":0.691123} gitlab # [ 285.574935] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8cf6302bf38574ffa43c74cc","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8cf6302bf38574ffa43c74cc: done: 0.015581 sec","job_status":"done","queue_duration_s":0.691104,"scheduling_latency_s":0.691123,"redis_calls":13,"redis_duration_s":0.0015270000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011129,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015581,"completed_at":"2026-08-20T05:58:04.614Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.616154] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c4a08247459b3e8428da5fd","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c4a08247459b3e8428da5fd: start","job_status":"start","queue_duration_s":0.707809,"scheduling_latency_s":0.707828} gitlab # [ 285.628942] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.628Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7c4a08247459b3e8428da5fd","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7c4a08247459b3e8428da5fd: done: 0.013796 sec","job_status":"done","queue_duration_s":0.707809,"scheduling_latency_s":0.707828,"redis_calls":13,"redis_duration_s":0.0014039999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009407,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013796,"completed_at":"2026-08-20T05:58:04.628Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.670909] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d332a8ddb447cb16ac0b71f","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d332a8ddb447cb16ac0b71f: start","job_status":"start","queue_duration_s":0.723093,"scheduling_latency_s":0.723111} gitlab # [ 285.683990] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1d332a8ddb447cb16ac0b71f","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1d332a8ddb447cb16ac0b71f: done: 0.014269 sec","job_status":"done","queue_duration_s":0.723093,"scheduling_latency_s":0.723111,"redis_calls":13,"redis_duration_s":0.001365,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00085,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014269,"completed_at":"2026-08-20T05:58:04.644Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.724936] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.645Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f35c530735741814852b066","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f35c530735741814852b066: start","job_status":"start","queue_duration_s":0.738418,"scheduling_latency_s":0.738436} gitlab # [ 285.737789] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.660Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f35c530735741814852b066","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f35c530735741814852b066: done: 0.014398 sec","job_status":"done","queue_duration_s":0.738418,"scheduling_latency_s":0.738436,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009994,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014398,"completed_at":"2026-08-20T05:58:04.660Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.778257] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec3b7fd47e7e3caf2007a951","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec3b7fd47e7e3caf2007a951: start","job_status":"start","queue_duration_s":0.753912,"scheduling_latency_s":0.753931} gitlab # [ 285.791195] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.677Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec3b7fd47e7e3caf2007a951","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec3b7fd47e7e3caf2007a951: done: 0.015917 sec","job_status":"done","queue_duration_s":0.753912,"scheduling_latency_s":0.753931,"redis_calls":13,"redis_duration_s":0.0015300000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000588,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015917,"completed_at":"2026-08-20T05:58:04.677Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.832628] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1bec0da351752505bd1de53","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1bec0da351752505bd1de53: start","job_status":"start","queue_duration_s":0.770957,"scheduling_latency_s":0.770976} gitlab # [ 285.845639] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f1bec0da351752505bd1de53","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f1bec0da351752505bd1de53: done: 0.015181 sec","job_status":"done","queue_duration_s":0.770957,"scheduling_latency_s":0.770976,"redis_calls":13,"redis_duration_s":0.0015559999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000996,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010531,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015181,"completed_at":"2026-08-20T05:58:04.693Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.888521] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.694Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5943544e8effca912d64a000","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5943544e8effca912d64a000: start","job_status":"start","queue_duration_s":0.787315,"scheduling_latency_s":0.787335} gitlab # [ 285.901217] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5943544e8effca912d64a000","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5943544e8effca912d64a000: done: 0.014941 sec","job_status":"done","queue_duration_s":0.787315,"scheduling_latency_s":0.787335,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014941,"completed_at":"2026-08-20T05:58:04.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.942754] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82145230e8f63a5d7c630895","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82145230e8f63a5d7c630895: start","job_status":"start","queue_duration_s":0.803355,"scheduling_latency_s":0.803374} gitlab # [ 285.956087] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82145230e8f63a5d7c630895","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82145230e8f63a5d7c630895: done: 0.014874 sec","job_status":"done","queue_duration_s":0.803355,"scheduling_latency_s":0.803374,"redis_calls":13,"redis_duration_s":0.001498,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009819,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014874,"completed_at":"2026-08-20T05:58:04.725Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 285.997441] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.727Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29bb0ee69f866c4370efeb99","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29bb0ee69f866c4370efeb99: start","job_status":"start","queue_duration_s":0.819859,"scheduling_latency_s":0.819879} gitlab # [ 286.010651] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29bb0ee69f866c4370efeb99","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29bb0ee69f866c4370efeb99: done: 0.016731 sec","job_status":"done","queue_duration_s":0.819859,"scheduling_latency_s":0.819879,"redis_calls":13,"redis_duration_s":0.001568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000545,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001023,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012075,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016731,"completed_at":"2026-08-20T05:58:04.743Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 286.051966] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.745Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ff88a8696298f6467ba49f1","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ff88a8696298f6467ba49f1: start","job_status":"start","queue_duration_s":0.837716,"scheduling_latency_s":0.837735} gitlab # [ 286.065265] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ff88a8696298f6467ba49f1","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ff88a8696298f6467ba49f1: done: 0.018314 sec","job_status":"done","queue_duration_s":0.837716,"scheduling_latency_s":0.837735,"redis_calls":13,"redis_duration_s":0.002457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00064,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001817,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018314,"completed_at":"2026-08-20T05:58:04.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 286.107465] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ba93ccd5ba3b24d53008972","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ba93ccd5ba3b24d53008972: start","job_status":"start","queue_duration_s":0.857152,"scheduling_latency_s":0.85717} gitlab # [ 286.120682] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.781Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4ba93ccd5ba3b24d53008972","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4ba93ccd5ba3b24d53008972: done: 0.017066 sec","job_status":"done","queue_duration_s":0.857152,"scheduling_latency_s":0.85717,"redis_calls":13,"redis_duration_s":0.001434,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017066,"completed_at":"2026-08-20T05:58:04.781Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 286.161754] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bda744f1d5676501df5ac70","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bda744f1d5676501df5ac70: start","job_status":"start","queue_duration_s":0.875264,"scheduling_latency_s":0.875283} gitlab # [ 286.175100] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.799Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bda744f1d5676501df5ac70","created_at":"2026-08-20T05:58:03.824Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-6b59ba675dab412b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"7d359a8e9e23ad6b6da0d17da66a9800","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.907Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bda744f1d5676501df5ac70: done: 0.01688 sec","job_status":"done","queue_duration_s":0.875264,"scheduling_latency_s":0.875283,"redis_calls":13,"redis_duration_s":0.001519,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000959,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01688,"completed_at":"2026-08-20T05:58:04.799Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 286.216488] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.800Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3094bd39a6aa30d36e75b8ec","created_at":"2026-08-20T05:58:03.963Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-e8852ee28aab4b8b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"252fd43af7e601209cb33e4420ffb02d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.973Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3094bd39a6aa30d36e75b8ec: start","job_status":"start","queue_duration_s":0.826849,"scheduling_latency_s":0.826868} gitlab # [ 286.229402] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.814Z","message":"No existing merge request to be cleaned up."} gitlab # [ 286.231248] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.825Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"3094bd39a6aa30d36e75b8ec","created_at":"2026-08-20T05:58:03.963Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-e8852ee28aab4b8b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"252fd43af7e601209cb33e4420ffb02d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.973Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-3094bd39a6aa30d36e75b8ec: done: 0.025048 sec","job_status":"done","queue_duration_s":0.826849,"scheduling_latency_s":0.826868,"redis_calls":10,"redis_duration_s":0.0014399999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000844,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025048,"completed_at":"2026-08-20T05:58:04.825Z","load_balancing_strategy":"primary","db_duration_s":0.003709,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 286.272199] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.826Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9bd9ddfabfb4caedf773cc4b","created_at":"2026-08-20T05:58:03.963Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-e8852ee28aab4b8b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"252fd43af7e601209cb33e4420ffb02d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.973Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9bd9ddfabfb4caedf773cc4b: start","job_status":"start","queue_duration_s":0.853027,"scheduling_latency_s":0.853046} gitlab # [ 286.286219] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.839Z","message":"No existing merge request to be cleaned up."} gitlab # [ 286.287953] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.850Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"9bd9ddfabfb4caedf773cc4b","created_at":"2026-08-20T05:58:03.963Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-e8852ee28aab4b8b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"252fd43af7e601209cb33e4420ffb02d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.973Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-9bd9ddfabfb4caedf773cc4b: done: 0.023342 sec","job_status":"done","queue_duration_s":0.853027,"scheduling_latency_s":0.853046,"redis_calls":10,"redis_duration_s":0.001499,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00064,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000859,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023342,"completed_at":"2026-08-20T05:58:04.850Z","load_balancing_strategy":"primary","db_duration_s":0.002739,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 286.328810] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.851Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ce6fa0e668acca9d838e07e4","created_at":"2026-08-20T05:58:03.963Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-e8852ee28aab4b8b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"252fd43af7e601209cb33e4420ffb02d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.973Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ce6fa0e668acca9d838e07e4: start","job_status":"start","queue_duration_s":0.877614,"scheduling_latency_s":0.877636} gitlab # [ 286.341649] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.865Z","message":"No existing merge request to be cleaned up."} gitlab # [ 286.343316] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.875Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"ce6fa0e668acca9d838e07e4","created_at":"2026-08-20T05:58:03.963Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-e8852ee28aab4b8b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"252fd43af7e601209cb33e4420ffb02d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.973Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-ce6fa0e668acca9d838e07e4: done: 0.02454 sec","job_status":"done","queue_duration_s":0.877614,"scheduling_latency_s":0.877636,"redis_calls":10,"redis_duration_s":0.001506,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000619,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000887,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015929,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02454,"completed_at":"2026-08-20T05:58:04.875Z","load_balancing_strategy":"primary","db_duration_s":0.003522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 286.384137] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.878Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1050723554f1c517da0a9d5a","created_at":"2026-08-20T05:58:03.963Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-e8852ee28aab4b8b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"252fd43af7e601209cb33e4420ffb02d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.973Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1050723554f1c517da0a9d5a: start","job_status":"start","queue_duration_s":0.904198,"scheduling_latency_s":0.904219} gitlab # [ 286.397082] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.890Z","message":"No existing merge request to be cleaned up."} gitlab # [ 286.398787] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:04.900Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1050723554f1c517da0a9d5a","created_at":"2026-08-20T05:58:03.963Z","trace_propagation_headers":{"sentry-trace":"5e14666ee96245cf816325ffb4d8f698-e8852ee28aab4b8b","baggage":"sentry-trace_id=5e14666ee96245cf816325ffb4d8f698,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"252fd43af7e601209cb33e4420ffb02d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:58:03.973Z","job_size_bytes":2,"pid":2078,"sidekiq_tid":"m7p2","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1050723554f1c517da0a9d5a: done: 0.02237 sec","job_status":"done","queue_duration_s":0.904198,"scheduling_latency_s":0.904219,"redis_calls":10,"redis_duration_s":0.001495,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000631,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000864,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02237,"completed_at":"2026-08-20T05:58:04.900Z","load_balancing_strategy":"primary","db_duration_s":0.002827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 309.181796] redis[784]: 10 changes in 300 seconds. Saving... gitlab # [ 309.187309] redis[784]: Background saving started by pid 3327 gitlab # [ 309.193919] redis[3327]: BGSAVE done, 443 keys saved, 0 keys skipped, 115624 bytes written. gitlab # [ 309.198570] redis[3327]: DB saved on disk gitlab # [ 309.200905] redis[3327]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB gitlab # [ 309.283590] redis[784]: Background saving terminated with success gitlab # [ 310.822877] postgres[860]: [860] LOG: checkpoint starting: time gitlab # [ 312.929602] gitaly[912]: time="2026-08-20T05:58:33.795Z" level=info msg="burden monitor stats" pid=912 gitlab # [ 326.005743] postgres[3373]: [3373] ERROR: relation "table_without_models" does not exist gitlab # [ 326.006164] postgres[3373]: [3373] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab # [ 332.359927] runuser[3030]: pam_unix(runuser:session): session closed for user gitlab gitlab # [ 332.361792] setup-gitlab-start[3007]: + systemctl restart gitlab-sidekiq.service gitlab # [ 332.395388] systemd[1]: Stopping gitlab-sidekiq.service... gitlab # [ 332.396950] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:53.262Z","message":"Shutting down"} gitlab # [ 332.398477] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:53.263Z","message":"Scheduler exiting..."} gitlab # [ 332.400154] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:53.264Z","message":"Terminating quiet threads for default capsule"} gitlab # [ 332.401962] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:53.266Z","message":"Scheduler exiting..."} gitlab # [ 332.901483] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:53.768Z","message":"Pausing to allow jobs to finish..."} gitlab # [ 334.409959] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:55.275Z","message":"Bye!"} gitlab # [ 334.461303] sidekiq-cluster[2078]: {"severity":"INFO","time":"2026-08-20T05:58:55.328Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2078,"worker_id":"sidekiq_0","memwd_rss_bytes":953151488,"retry":0} gitlab # [ 336.046310] systemd[1]: gitlab-sidekiq.service: Deactivated successfully. gitlab # [ 336.046749] systemd[1]: Stopped gitlab-sidekiq.service. gitlab # [ 336.046974] systemd[1]: gitlab-sidekiq.service: Consumed 1min 55.660s CPU time over 3min 25.467s wall clock time, 947.9M memory peak, 4.5M read from disk. gitlab # [ 336.060806] systemd[1]: Started gitlab-sidekiq.service. gitlab # [ 336.065179] setup-gitlab-start[3007]: + mkdir -p /var/lib/secrets gitlab # [ 336.070353] setup-gitlab-start[3007]: + echo nixbot-test-token-of-20-chars gitlab # [ 336.073350] setup-gitlab-start[3007]: + chmod 644 /var/lib/secrets/gitlab-token gitlab # [ 336.076388] setup-gitlab-start[3007]: + curl -fs -X POST -H 'PRIVATE-TOKEN: nixbot-test-token-of-20-chars' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects gitlab # [ 338.351234] gitaly[912]: time="2026-08-20T05:58:59.217Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:59:09.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:59.216" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 338.381784] gitaly[912]: time="2026-08-20T05:58:59.218Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:59:09.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:59.216" grpc.time_ms=1.464 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 338.866713] gitaly[912]: time="2026-08-20T05:58:59.734Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:59:09.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:59.733" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 338.899068] gitaly[912]: time="2026-08-20T05:58:59.734Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:59:09.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:59.733" grpc.time_ms=0.659 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 338.980954] gitaly[912]: time="2026-08-20T05:58:59.848Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 diskcache=81dffae0-ecc2-4fd7-85a8-60df7f8d72d8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:59:09.050" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:59.780" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 339.012510] gitaly[912]: time="2026-08-20T05:58:59.848Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=38 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1442 command.oublock=32 command.real_time_ms=43 command.spawn_token_fork_ms=6 command.system_time_ms=31 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:59:09.050" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:59.780" grpc.time_ms=67.614 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 339.040315] gitaly[912]: time="2026-08-20T05:58:59.884Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:59:09.152" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:59.883" pid=912 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 339.056469] gitaly[912]: time="2026-08-20T05:58:59.885Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:59:09.152" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:59.883" grpc.time_ms=1.946 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 339.071151] gitaly[912]: time="2026-08-20T05:58:59.918Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:59:09.176" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:58:59.907" grpc.time_ms=11.078 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 339.221343] gitaly[912]: time="2026-08-20T05:59:00.088Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:59:10.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:00.088" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 339.253837] gitaly[912]: time="2026-08-20T05:59:00.089Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:59:10.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:00.088" grpc.time_ms=0.649 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 339.288794] gitaly[912]: time="2026-08-20T05:59:00.156Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 diskcache=3e9be87e-9b98-4601-9173-2d91ff19a83a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:59:10.011" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:00.092" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 339.316438] gitaly[912]: time="2026-08-20T05:59:00.156Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=39 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1438 command.oublock=32 command.real_time_ms=41 command.spawn_token_fork_ms=2 command.system_time_ms=26 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-08-20T05:59:10.011" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:00.092" grpc.time_ms=63.931 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 339.341877] gitaly[912]: time="2026-08-20T05:59:00.177Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:59:10.095" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:00.176" pid=912 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root gitlab # [ 339.357671] gitaly[912]: time="2026-08-20T05:59:00.177Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:59:10.095" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:00.176" grpc.time_ms=0.892 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 339.373216] gitaly[912]: time="2026-08-20T05:59:00.202Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:59:10.109" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:00.189" grpc.time_ms=12.636 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 339.452519] gitaly[912]: time="2026-08-20T05:59:00.319Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T05:59:10.108" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:00.319" grpc.time_ms=0.375 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 339.496282] gitaly[912]: time="2026-08-20T05:59:00.363Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:59:10.151" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:00.362" grpc.time_ms=0.655 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 341.366665] gitaly[912]: time="2026-08-20T05:59:02.233Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0K6BTH9RNQNW6M41Q0Z8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:59:12.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:02.212" grpc.time_ms=19.892 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 341.377480] sidekiq-cluster[3440]: {"severity":"INFO","time":"2026-08-20T05:59:02.199Z","message":"Starting cluster with 1 processes"} gitlab # [ 342.006197] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:02 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 5898 gitlab # [ 342.019461] setup-gitlab-start[3007]: + mkdir -p /tmp/test-flake gitlab # [ 342.022161] setup-gitlab-start[3007]: + cd /tmp/test-flake gitlab # [ 342.024543] setup-gitlab-start[3007]: + git init -b master gitlab # [ 342.036780] setup-gitlab-start[3509]: Initialized empty Git repository in /tmp/test-flake/.git/ gitlab # [ 342.040568] setup-gitlab-start[3007]: + git config user.name test gitlab # [ 342.043115] setup-gitlab-start[3007]: + git config user.email test@example.com gitlab # [ 342.046311] setup-gitlab-start[3007]: + cat gitlab # [ 342.048175] setup-gitlab-start[3007]: + git add flake.nix gitlab # [ 342.051144] setup-gitlab-start[3007]: + git commit -m 'initial commit' gitlab # [ 342.065743] setup-gitlab-start[3514]: [master (root-commit) f9e25ab] initial commit gitlab # [ 342.070023] setup-gitlab-start[3514]: 1 file changed, 10 insertions(+) gitlab # [ 342.072863] setup-gitlab-start[3514]: create mode 100644 flake.nix gitlab # [ 342.075459] setup-gitlab-start[3007]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git gitlab # [ 342.081217] setup-gitlab-start[3007]: + git push -u origin master gitlab # [ 342.228884] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:03 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 98 gitlab # [ 342.938869] gitaly[912]: time="2026-08-20T05:59:03.805Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0S5TR4D62TYPHFH8NMVV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:03.788" grpc.time_ms=16.133 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 342.940320] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:03 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 709 gitlab # [ 343.457105] gitaly[912]: time="2026-08-20T05:59:04.324Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=570 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=6 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:59:14.005" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:04.305" grpc.time_ms=18.485 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 343.584000] gitaly[912]: time="2026-08-20T05:59:04.451Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:59:34.032" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:59:04.433" grpc.time_ms=17.759 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 343.742878] gitaly[912]: time="2026-08-20T05:59:04.610Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 duration_ms=524ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 343.802787] gitaly[912]: time="2026-08-20T05:59:04.670Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 duration_ms=58ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 343.807150] gitaly[912]: time="2026-08-20T05:59:04.671Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:59:04.082" grpc.time_ms=588.452 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 343.862291] gitaly[912]: time="2026-08-20T05:59:04.729Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:59:04.728" grpc.time_ms=1.391 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 343.965042] gitaly[912]: time="2026-08-20T05:59:04.831Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:59:04.829" grpc.time_ms=1.808 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 344.033531] gitaly[912]: time="2026-08-20T05:59:04.900Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:59:04.898" grpc.time_ms=2.073 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 344.258138] gitaly[912]: time="2026-08-20T05:59:05.125Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T05:59:15.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:05.107" grpc.time_ms=17.867 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.318404] gitaly[912]: time="2026-08-20T05:59:05.185Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=31 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1432 command.oublock=0 command.real_time_ms=37 command.spawn_token_fork_ms=5 command.system_time_ms=24 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T05:59:15.041" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:05.142" grpc.time_ms=42.567 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 344.342329] gitaly[912]: time="2026-08-20T05:59:05.209Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 duration_ms=250ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 344.350105] gitaly[912]: time="2026-08-20T05:59:05.211Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:59:04.958" grpc.time_ms=252.248 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 344.368123] gitaly[912]: time="2026-08-20T05:59:05.225Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 diskcache=8e802eea-cad1-43d6-b2ef-daa246607b2a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:03.958" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 344.384671] setup-gitlab-start[3518]: To http://gitlab/root/test-flake.git gitlab # [ 344.386115] setup-gitlab-start[3518]: * [new branch] master -> master gitlab # [ 344.387481] setup-gitlab-start[3518]: branch 'master' set up to track 'origin/master'. gitlab # [ 344.389551] gitlab-workhorse[819]: time="2026-08-20T05:59:05Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # [ 344.392187] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:05 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 1368 gitlab # [ 344.395129] systemd[1]: Finished setup-gitlab.service. gitlab # [ 344.396224] gitaly[912]: time="2026-08-20T05:59:05.230Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=373 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13674 command.oublock=32 command.real_time_ms=1259 command.spawn_token_fork_ms=0 command.system_time_ms=213 command.user_time_ms=160 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=686 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:03.958" grpc.time_ms=1267.679 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 344.413556] systemd[1]: Starting nixbot CI service... gitlab: (finished: waiting for unit setup-gitlab.service, in 345.61 seconds) gitlab: waiting for unit nixbot.service gitlab # [ 345.796092] nixbot[3607]: {"ts": "2026-08-20T05:59:06.662Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"} gitlab # [ 345.820152] nixbot[3607]: {"ts": "2026-08-20T05:59:06.687Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"} gitlab # [ 345.839990] nixbot[3607]: {"ts": "2026-08-20T05:59:06.707Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"} gitlab # [ 345.849407] nixbot[3607]: {"ts": "2026-08-20T05:59:06.716Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"} gitlab # [ 345.857504] nixbot[3607]: {"ts": "2026-08-20T05:59:06.724Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"} gitlab # [ 345.869188] nixbot[3607]: {"ts": "2026-08-20T05:59:06.736Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"} gitlab # [ 345.876823] nixbot[3607]: {"ts": "2026-08-20T05:59:06.744Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"} gitlab # [ 345.880157] nixbot[3607]: {"ts": "2026-08-20T05:59:06.747Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"} gitlab # [ 345.891420] nixbot[3607]: {"ts": "2026-08-20T05:59:06.758Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"} gitlab # [ 345.895767] nixbot[3607]: {"ts": "2026-08-20T05:59:06.762Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"} gitlab # [ 345.904785] nixbot[3607]: {"ts": "2026-08-20T05:59:06.772Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"} gitlab # [ 345.916862] nixbot[3607]: {"ts": "2026-08-20T05:59:06.784Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"} gitlab # [ 345.922886] nixbot[3607]: {"ts": "2026-08-20T05:59:06.790Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"} gitlab # [ 345.926804] nixbot[3607]: {"ts": "2026-08-20T05:59:06.794Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"} gitlab # [ 345.934234] nixbot[3607]: {"ts": "2026-08-20T05:59:06.801Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"} gitlab # [ 345.938617] nixbot[3607]: {"ts": "2026-08-20T05:59:06.805Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"} gitlab # [ 345.942835] nixbot[3607]: {"ts": "2026-08-20T05:59:06.808Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"} gitlab # [ 345.947095] nixbot[3607]: {"ts": "2026-08-20T05:59:06.811Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"} gitlab # [ 345.952359] nixbot[3607]: {"ts": "2026-08-20T05:59:06.819Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"} gitlab # [ 345.956205] nixbot[3607]: {"ts": "2026-08-20T05:59:06.822Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"} gitlab # [ 345.960106] nixbot[3607]: {"ts": "2026-08-20T05:59:06.825Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"} gitlab # [ 345.967317] nixbot[3607]: {"ts": "2026-08-20T05:59:06.834Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"} gitlab # [ 345.971470] nixbot[3607]: {"ts": "2026-08-20T05:59:06.837Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"} gitlab # [ 345.975650] nixbot[3607]: {"ts": "2026-08-20T05:59:06.841Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"} gitlab # [ 345.979642] nixbot[3607]: {"ts": "2026-08-20T05:59:06.843Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"} gitlab # [ 346.413577] nixbot[3607]: INFO: Started server process [3607] gitlab # [ 346.417150] nixbot[3607]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit) gitlab # [ 346.462876] nixbot[3607]: INFO: ::ffff:127.0.0.1:48320 - "GET /health HTTP/1.1" 200 OK gitlab # [ 346.473846] systemd[1]: Started nixbot CI service. gitlab # [ 346.479701] systemd[1]: Reached target Multi-User System. gitlab # [ 346.483465] systemd[1]: Startup finished in 783ms (kernel) + 4.640s (initrd) + 5min 41.059s (userspace) = 5min 46.482s. gitlab: (finished: waiting for unit nixbot.service, in 2.12 seconds) gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health gitlab # [ 347.335716] nixbot[3607]: INFO: ::ffff:127.0.0.1:48330 - "GET /health HTTP/1.1" 200 OK gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds) subtest: project discovered and webhook registered gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.21 seconds) gitlab # [ 347.549823] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:08 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 149 gitlab # [ 348.033537] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:08 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 1572 gitlab # [ 348.037049] nixbot[3607]: {"ts": "2026-08-20T05:59:08.904Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 348.063498] nixbot[3607]: {"ts": "2026-08-20T05:59:08.930Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1} gitlab # [ 348.160689] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 81 gitlab # [ 348.167386] nixbot[3607]: {"ts": "2026-08-20T05:59:09.029Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 348.174554] nixbot[3607]: {"ts": "2026-08-20T05:59:09.031Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"} gitlab # [ 348.302587] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:09 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 919 "" "python-httpx/0.28.1" 136 gitlab # [ 348.309381] nixbot[3607]: {"ts": "2026-08-20T05:59:09.171Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks gitlab # [ 348.613112] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:09 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 296 gitlab # [ 348.629466] nixbot[3607]: {"ts": "2026-08-20T05:59:09.489Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.20 seconds) (finished: subtest: project discovered and webhook registered, in 1.42 seconds) subtest: push delivers the webhook gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master gitlab # [ 348.748334] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "curl/8.21.0" 143 gitlab # [ 348.764661] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 882 "" "python-httpx/0.28.1" 118 gitlab # [ 348.766965] nixbot[3607]: {"ts": "2026-08-20T05:59:09.633Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""} gitlab # [ 348.859299] nixbot[3607]: {"ts": "2026-08-20T05:59:09.726Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""} gitlab # [ 348.862873] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:09 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 919 "" "python-httpx/0.28.1" 91 gitlab # [ 348.906832] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:09 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 66 gitlab # [ 348.962931] gitaly[912]: time="2026-08-20T05:59:09.829Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0ZNDT6ZKKNFBXP2PFHV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-08-20T05:59:39.099" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:09.801" grpc.time_ms=27.114 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 349.002934] gitaly[912]: time="2026-08-20T05:59:09.852Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0ZNDT6ZKKNFBXP2PFHV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:39.147" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:59:09.848" grpc.time_ms=4.073 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 349.024652] gitaly[912]: time="2026-08-20T05:59:09.872Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=11 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0ZNDT6ZKKNFBXP2PFHV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-08-20T05:59:19.125" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:59:09.856" grpc.time_ms=15.728 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 349.044469] gitaly[912]: time="2026-08-20T05:59:09.897Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=11 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZPNN7B02VS2EZ6XCPFB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:09.880" grpc.time_ms=16.517 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 349.058577] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:09 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 203 "" "git/2.55.0" 115 gitlab # [ 349.060872] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:09 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 168 gitlab # [ 349.063459] nixbot[3607]: {"ts": "2026-08-20T05:59:09.911Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""} gitlab # Enumerating objects: 5, done. gitlab # Counting objects: 20% (1/5)Counting objects: 40% (2/5)Counting objects: 60% (3/5)Counting objects: 80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done. gitlab # Delta compression using up to 4 threads gitlab # Compressing objects: 50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done. gitlab # Writing objects: 33% (1/3)Writing objects: 66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 274 bytes | 54.00 KiB/s, done. gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0) gitlab # [ 349.152169] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:10 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 101 gitlab # [ 349.154866] nixbot[3607]: {"ts": "2026-08-20T05:59:10.019Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""} gitlab # [ 349.164485] nixbot[3607]: {"ts": "2026-08-20T05:59:10.031Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null} gitlab # [ 349.320658] gitaly[912]: time="2026-08-20T05:59:10.188Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW100T0SK52QWW6DA0SA65 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:10.173" grpc.time_ms=14.034 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 349.353735] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 90 gitlab # [ 349.451043] gitaly[912]: time="2026-08-20T05:59:10.318Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=12 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-08-20T05:59:40.099" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-08-20T05:59:10.299" grpc.time_ms=18.436 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 349.488446] gitaly[912]: time="2026-08-20T05:59:10.343Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M0EW0ZW47E5QZEGR9F67721T duration_ms=160ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/allowed" gitlab # [ 349.555425] gitaly[912]: time="2026-08-20T05:59:10.422Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M0EW0ZW47E5QZEGR9F67721T duration_ms=77ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/pre_receive" gitlab # [ 349.565500] gitaly[912]: time="2026-08-20T05:59:10.423Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:59:10.180" grpc.time_ms=243.131 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 349.614198] gitaly[912]: time="2026-08-20T05:59:10.481Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:59:10.480" grpc.time_ms=0.972 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 349.637473] gitaly[912]: time="2026-08-20T05:59:10.505Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW104DHDCE0WV6G721THBG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:10.477" pid=912 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc gitlab # [ 349.656432] gitaly[912]: time="2026-08-20T05:59:10.506Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW104DHDCE0WV6G721THBG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:10.477" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 349.676788] gitlab-workhorse[819]: time="2026-08-20T05:59:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=113 gitlab # [ 349.679327] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 286 gitlab # [ 349.681934] gitaly[912]: time="2026-08-20T05:59:10.515Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW104DHDCE0WV6G721THBG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:10.477" grpc.time_ms=28.99 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 349.699698] gitaly[912]: time="2026-08-20T05:59:10.549Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:59:10.548" grpc.time_ms=0.586 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 349.723036] gitaly[912]: time="2026-08-20T05:59:10.590Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:59:10.589" grpc.time_ms=0.457 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # [ 349.747658] gitaly[912]: time="2026-08-20T05:59:10.615Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW10DHTRRRR1YZFSWF19EQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:10.588" pid=912 remote_ip="2001:db8:1::1" request_sha=11c9d3f9e6b1b9bb10286b194d841d23f76a28e5 response_bytes=223 span.kind=server system=grpc gitlab # [ 349.765224] gitaly[912]: time="2026-08-20T05:59:10.615Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=6 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW10DHTRRRR1YZFSWF19EQ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:10.588" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 349.782287] gitlab-workhorse[819]: time="2026-08-20T05:59:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=223 gitlab # [ 349.784452] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 102 gitlab # [ 349.786639] gitaly[912]: time="2026-08-20T05:59:10.615Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1137 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=6 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW10DHTRRRR1YZFSWF19EQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:10.588" grpc.time_ms=26.599 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 349.880109] gitaly[912]: time="2026-08-20T05:59:10.747Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M0EW0ZW47E5QZEGR9F67721T duration_ms=119ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/post_receive" gitlab # [ 349.885558] gitaly[912]: time="2026-08-20T05:59:10.748Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:59:10.626" grpc.time_ms=121.565 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # To http://gitlab/root/test-flake.git gitlab # [ 349.903679] gitaly[912]: time="2026-08-20T05:59:10.760Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T diskcache=852c8d62-a5a7-4338-be40-265442b7874f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:10.084" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab # f9e25ab..592ba8e [ 349.918838] gitlab-workhorse[819]: time="2026-08-20T05:59:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=52 gitlab # master -> master[ 349.921499] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:10 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 804 gitlab # gitlab # [ 349.924068] gitaly[912]: time="2026-08-20T05:59:10.761Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=231 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13014 command.oublock=32 command.real_time_ms=670 command.spawn_token_fork_ms=1 command.system_time_ms=128 command.user_time_ms=103 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=606 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:10.084" grpc.time_ms=676.563 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.19 seconds) gitlab: must succeed: git -C /tmp/test-flake rev-parse master gitlab # [ 349.942826] gitaly[912]: time="2026-08-20T05:59:10.810Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW10JG53D6E1CKATRAF5NP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:10.798" grpc.time_ms=11.417 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 349.963915] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:10 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 137 gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.03 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 350.054379] gitaly[912]: time="2026-08-20T05:59:10.920Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW10PW4E1WGWA5VT20RSGE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:10.904" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.11 seconds) gitlab # [ 350.076493] gitaly[912]: time="2026-08-20T05:59:10.921Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW10PW4E1WGWA5VT20RSGE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:10.904" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 350.094211] nixbot[3607]: INFO: ::ffff:127.0.0.1:48332 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab # [ 350.096531] gitlab-workhorse[819]: time="2026-08-20T05:59:10Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 350.098632] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:10 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 109 gitlab # [ 350.100814] gitaly[912]: time="2026-08-20T05:59:10.921Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW10PW4E1WGWA5VT20RSGE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:10.904" grpc.time_ms=17.152 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 350.176285] gitaly[912]: time="2026-08-20T05:59:11.043Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW10TVC9KMGTWE1JWWKHWX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:11.013" pid=912 remote_ip="2001:db8:1::1" request_sha=9035cb9e91e8992ec2c2c82077e0689fb9ece81e response_bytes=338 span.kind=server system=grpc gitlab # [ 350.194706] gitaly[912]: time="2026-08-20T05:59:11.044Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=25 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1128 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=1 command.system_time_ms=16 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW10TVC9KMGTWE1JWWKHWX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:11.013" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 350.215905] gitlab-workhorse[819]: time="2026-08-20T05:59:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=338 gitlab # [ 350.218594] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 338 "" "git/2.55.0" 105 gitlab # [ 350.222393] gitaly[912]: time="2026-08-20T05:59:11.044Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=25 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1128 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=1 command.system_time_ms=16 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW10TVC9KMGTWE1JWWKHWX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=22 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:11.013" grpc.time_ms=31.332 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=1 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 350.348584] gitaly[912]: time="2026-08-20T05:59:11.215Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW110QF9BEHF4CFG7W6FFW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:11.197" grpc.time_ms=17.689 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 350.369561] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:11 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 90 gitlab # [ 350.488928] gitaly[912]: time="2026-08-20T05:59:11.356Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW113NY8RW6TQSA1CSSVYJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:11.321" pid=912 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc gitlab # [ 350.521459] gitaly[912]: time="2026-08-20T05:59:11.356Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=22 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW113NY8RW6TQSA1CSSVYJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:11.321" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 350.553661] gitlab-workhorse[819]: time="2026-08-20T05:59:11Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=209 gitlab # [ 350.560217] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:11 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 136 gitlab # [ 350.567247] gitaly[912]: time="2026-08-20T05:59:11.357Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=29 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1100 command.oublock=0 command.real_time_ms=31 command.spawn_token_fork_ms=2 command.system_time_ms=22 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW113NY8RW6TQSA1CSSVYJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:11.321" grpc.time_ms=35.832 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 350.693700] gitaly[912]: time="2026-08-20T05:59:11.561Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:41.058" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:59:11.559" grpc.time_ms=1.469 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 350.767771] gitaly[912]: time="2026-08-20T05:59:11.635Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T05:59:41.113" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:11.613" grpc.time_ms=21.042 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 350.818226] gitaly[912]: time="2026-08-20T05:59:11.685Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=9 component=gitaly.StreamServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:21.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:11.668" grpc.time_ms=16.478 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 350.860530] gitaly[912]: time="2026-08-20T05:59:11.728Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=3 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:21.048" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:11.708" grpc.time_ms=18.945 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 351.012052] gitaly[912]: time="2026-08-20T05:59:11.879Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T05:59:21.217" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:11.878" grpc.time_ms=0.684 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 351.049889] gitaly[912]: time="2026-08-20T05:59:11.917Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=12 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T05:59:21.236" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:11.897" grpc.time_ms=19.837 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 351.134933] nixbot[3607]: INFO: ::ffff:127.0.0.1:55368 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.07 seconds) gitlab # [ 351.144192] gitaly[912]: time="2026-08-20T05:59:12.006Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:59:12.005" grpc.time_ms=0.799 pid=912 span.kind=server system=grpc gitlab # [ 351.186596] gitaly[912]: time="2026-08-20T05:59:12.053Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T05:59:12.052" grpc.time_ms=0.907 pid=912 span.kind=server system=grpc gitlab # [ 351.213454] gitaly[912]: time="2026-08-20T05:59:12.080Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 diskcache=3b5de4d9-f84d-4222-bdc5-a5cff7c36534 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:59:21.261" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:11.922" pid=912 ref=refs/keep-around/f9e25abb020f765c8d7b6df0016c81ee0bc22174 remote_ip="2001:db8:1::1" revision=f9e25abb020f765c8d7b6df0016c81ee0bc22174 span.kind=server system=grpc username=root gitlab # [ 351.232093] gitaly[912]: time="2026-08-20T05:59:12.081Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=122 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5532 command.oublock=8 command.real_time_ms=149 command.spawn_token_fork_ms=3 command.system_time_ms=63 command.user_time_ms=59 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T05:59:21.261" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T05:59:11.922" grpc.time_ms=158.457 pid=912 ref=refs/keep-around/f9e25abb020f765c8d7b6df0016c81ee0bc22174 remote_ip="2001:db8:1::1" revision=f9e25abb020f765c8d7b6df0016c81ee0bc22174 span.kind=server system=grpc username=root gitlab # [ 351.252885] gitaly[912]: time="2026-08-20T05:59:12.098Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:42.096" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:59:12.097" grpc.time_ms=0.765 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 351.548915] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:12 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 990 gitlab # [ 351.557411] nixbot[3607]: {"ts": "2026-08-20T05:59:12.417Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 \"HTTP/1.1 201 Created\""} gitlab # [ 351.566510] nixbot[3607]: {"ts": "2026-08-20T05:59:12.432Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-f9e25abb020f-0"} gitlab # [ 351.640854] systemd[1]: Started Nix Daemon. gitlab # [ 351.754486] nix-daemon[3831]: accepted connection from pid 3825, user nixbot gitlab # [ 351.894031] nix-daemon[3831]: accepted connection from pid 3838, user nixbot gitlab # [ 351.920199] nixbot[3607]: {"ts": "2026-08-20T05:59:12.787Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-f9e25abb020f-0", "argv0": "bwrap"} gitlab # [ 352.141179] nix-daemon[3831]: accepted connection from pid 3848, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 352.186648] nixbot[3607]: INFO: ::ffff:127.0.0.1:55382 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 352.282501] nix-daemon[3831]: accepted connection from pid 3861, user nixbot gitlab # [ 352.307889] nix-daemon[3831]: accepted connection from pid 3848, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 353.247647] nixbot[3607]: INFO: ::ffff:127.0.0.1:55386 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 354.304393] nixbot[3607]: INFO: ::ffff:127.0.0.1:55396 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 355.361286] nixbot[3607]: INFO: ::ffff:127.0.0.1:55410 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 356.417977] nixbot[3607]: INFO: ::ffff:127.0.0.1:55416 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 357.373695] gitaly[912]: time="2026-08-20T05:59:18.240Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW17P9DP40DEKBFGY1SWX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:48.237" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:59:18.238" grpc.time_ms=1.222 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 357.465400] nixbot[3607]: INFO: ::ffff:127.0.0.1:55426 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 357.670154] gitaly[912]: time="2026-08-20T05:59:18.537Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW17P9DP40DEKBFGY1SWX9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:28.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:18.519" grpc.time_ms=18.062 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 357.826199] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 730 gitlab # [ 357.835995] nixbot[3607]: {"ts": "2026-08-20T05:59:18.694Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 \"HTTP/1.1 201 Created\""} gitlab # [ 357.931590] gitaly[912]: time="2026-08-20T05:59:18.798Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW18DE2GQDBMF7MMMXXBPX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:48.796" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:59:18.797" grpc.time_ms=1.373 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 358.011594] gitaly[912]: time="2026-08-20T05:59:18.878Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW18DE2GQDBMF7MMMXXBPX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:28.200" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:18.860" grpc.time_ms=17.787 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 358.110364] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:18 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 275 gitlab # [ 358.115352] nixbot[3607]: {"ts": "2026-08-20T05:59:18.980Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 \"HTTP/1.1 201 Created\""} gitlab # [ 358.222609] gitaly[912]: time="2026-08-20T05:59:19.089Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW18PT1NGGM57MVMHBFDNM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T05:59:49.087" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T05:59:19.088" grpc.time_ms=1.225 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 358.280192] gitaly[912]: time="2026-08-20T05:59:19.147Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0EW18PT1NGGM57MVMHBFDNM grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T05:59:29.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T05:59:19.128" grpc.time_ms=18.354 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 358.395377] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:19 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 259 gitlab # [ 358.406622] nixbot[3607]: {"ts": "2026-08-20T05:59:19.264Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 \"HTTP/1.1 201 Created\""} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 358.526680] nixbot[3607]: INFO: ::ffff:127.0.0.1:55428 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab # [ 358.560460] nix-daemon[3831]: accepted connection from pid 3904, user nixbot gitlab # [ 358.717177] gitaly[912]: time="2026-08-20T05:59:19.584Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW196EMNWFK8V0MWSSX97V grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=192 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:19.569" grpc.time_ms=14.606 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 358.734041] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:19 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 84 gitlab # [ 358.879121] gitaly[912]: time="2026-08-20T05:59:19.746Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW1995QAYSSRV3GAC772GT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:19.726" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 358.910135] gitaly[912]: time="2026-08-20T05:59:19.746Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW1995QAYSSRV3GAC772GT grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:19.726" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 358.937515] gitlab-workhorse[819]: time="2026-08-20T05:59:19Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 358.940555] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:05:59:19 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 158 gitlab # [ 358.943501] gitaly[912]: time="2026-08-20T05:59:19.747Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW1995QAYSSRV3GAC772GT grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T05:59:19.726" grpc.time_ms=20.823 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 359.044917] nix-daemon[3831]: accepted connection from pid 3932, user nixbot gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 359.587598] nixbot[3607]: INFO: ::ffff:127.0.0.1:55438 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 360.644633] nixbot[3607]: INFO: ::ffff:127.0.0.1:55448 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 361.702031] nixbot[3607]: INFO: ::ffff:127.0.0.1:43414 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 362.757698] nixbot[3607]: INFO: ::ffff:127.0.0.1:43430 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 363.812823] nixbot[3607]: INFO: ::ffff:127.0.0.1:43440 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 364.866657] nixbot[3607]: INFO: ::ffff:127.0.0.1:43450 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 365.924829] nixbot[3607]: INFO: ::ffff:127.0.0.1:43452 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 366.980799] nixbot[3607]: INFO: ::ffff:127.0.0.1:43454 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 368.036250] nixbot[3607]: INFO: ::ffff:127.0.0.1:43456 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 369.090120] nixbot[3607]: INFO: ::ffff:127.0.0.1:43470 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 370.146175] nixbot[3607]: INFO: ::ffff:127.0.0.1:43474 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 371.202042] nixbot[3607]: INFO: ::ffff:127.0.0.1:45294 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 372.261829] nixbot[3607]: INFO: ::ffff:127.0.0.1:45296 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 373.316986] nixbot[3607]: INFO: ::ffff:127.0.0.1:45310 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 374.371633] nixbot[3607]: INFO: ::ffff:127.0.0.1:45326 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 375.424763] nixbot[3607]: INFO: ::ffff:127.0.0.1:45336 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 376.483100] nixbot[3607]: INFO: ::ffff:127.0.0.1:45350 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 377.537621] nixbot[3607]: INFO: ::ffff:127.0.0.1:45364 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 378.594601] nixbot[3607]: INFO: ::ffff:127.0.0.1:45372 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 379.649602] nixbot[3607]: INFO: ::ffff:127.0.0.1:45384 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 380.705030] nixbot[3607]: INFO: ::ffff:127.0.0.1:45388 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 381.765322] nixbot[3607]: INFO: ::ffff:127.0.0.1:35172 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 382.816870] nixbot[3607]: INFO: ::ffff:127.0.0.1:35184 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 383.874913] nixbot[3607]: INFO: ::ffff:127.0.0.1:35190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 384.799074] sidekiq-cluster[3499]: 2026-08-20T05:59:45.665Z pid=3499 tid=ykj INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3499, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>426205184} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 384.932154] nixbot[3607]: INFO: ::ffff:127.0.0.1:35192 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 385.090331] sidekiq-cluster[3499]: W, [2026-08-20T05:59:45.957600 #3499] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`. gitlab # [ 385.237486] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T05:59:46.104Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 385.987714] nixbot[3607]: INFO: ::ffff:127.0.0.1:35208 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 387.043251] nixbot[3607]: INFO: ::ffff:127.0.0.1:35218 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 388.099937] nixbot[3607]: INFO: ::ffff:127.0.0.1:35234 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab # [ 388.330347] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T05:59:49.196Z","message":"GitLab reliable fetch activated!"} gitlab # [ 388.335514] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T05:59:49.197Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 389.153104] nixbot[3607]: INFO: ::ffff:127.0.0.1:35240 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 390.206610] nixbot[3607]: INFO: ::ffff:127.0.0.1:35242 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 391.263757] nixbot[3607]: INFO: ::ffff:127.0.0.1:33408 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 392.319836] nixbot[3607]: INFO: ::ffff:127.0.0.1:33418 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 393.374700] nixbot[3607]: INFO: ::ffff:127.0.0.1:33428 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 394.428779] nixbot[3607]: INFO: ::ffff:127.0.0.1:33438 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 395.483497] nixbot[3607]: INFO: ::ffff:127.0.0.1:33446 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 396.538954] nixbot[3607]: INFO: ::ffff:127.0.0.1:33450 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 397.594188] nixbot[3607]: INFO: ::ffff:127.0.0.1:33466 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 398.649716] nixbot[3607]: INFO: ::ffff:127.0.0.1:33476 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 399.634587] systemd[1]: Starting Logrotate Service... gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 399.706423] nixbot[3607]: INFO: ::ffff:127.0.0.1:33486 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 399.764629] systemd[1]: logrotate.service: Deactivated successfully. gitlab # [ 399.767592] systemd[1]: Finished Logrotate Service. gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 400.762092] nixbot[3607]: INFO: ::ffff:127.0.0.1:33500 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 401.815732] nixbot[3607]: INFO: ::ffff:127.0.0.1:56336 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 402.869438] nixbot[3607]: INFO: ::ffff:127.0.0.1:56352 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 403.923085] nixbot[3607]: INFO: ::ffff:127.0.0.1:56356 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 404.978947] nixbot[3607]: INFO: ::ffff:127.0.0.1:56360 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 406.033673] nixbot[3607]: INFO: ::ffff:127.0.0.1:56362 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 407.088217] nixbot[3607]: INFO: ::ffff:127.0.0.1:56374 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 408.143176] nixbot[3607]: INFO: ::ffff:127.0.0.1:56378 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 409.198008] nixbot[3607]: INFO: ::ffff:127.0.0.1:56388 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 410.250567] nixbot[3607]: INFO: ::ffff:127.0.0.1:56404 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 411.306891] nixbot[3607]: INFO: ::ffff:127.0.0.1:44144 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 412.362520] nixbot[3607]: INFO: ::ffff:127.0.0.1:44158 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 413.418619] nixbot[3607]: INFO: ::ffff:127.0.0.1:44160 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 414.474669] nixbot[3607]: INFO: ::ffff:127.0.0.1:44170 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 415.530691] nixbot[3607]: INFO: ::ffff:127.0.0.1:44176 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 416.587789] nixbot[3607]: INFO: ::ffff:127.0.0.1:44188 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 417.643980] nixbot[3607]: INFO: ::ffff:127.0.0.1:44190 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 418.699165] nixbot[3607]: INFO: ::ffff:127.0.0.1:44200 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 419.754535] nixbot[3607]: INFO: ::ffff:127.0.0.1:44208 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 420.810508] nixbot[3607]: INFO: ::ffff:127.0.0.1:44220 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 421.863129] nixbot[3607]: INFO: ::ffff:127.0.0.1:52942 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 422.918007] nixbot[3607]: INFO: ::ffff:127.0.0.1:52950 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 423.974213] nixbot[3607]: INFO: ::ffff:127.0.0.1:52954 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 425.030616] nixbot[3607]: INFO: ::ffff:127.0.0.1:52970 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab # [ 425.460738] postgres[4144]: [4144] ERROR: relation "table_without_models" does not exist gitlab # [ 425.464331] postgres[4144]: [4144] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id') gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 426.084934] nixbot[3607]: INFO: ::ffff:127.0.0.1:52984 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 427.139687] nixbot[3607]: INFO: ::ffff:127.0.0.1:53000 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 428.196430] nixbot[3607]: INFO: ::ffff:127.0.0.1:53006 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 429.253503] nixbot[3607]: INFO: ::ffff:127.0.0.1:53020 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 430.311185] nixbot[3607]: INFO: ::ffff:127.0.0.1:53032 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 430.440785] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:31.307Z","message":"Booted Rails 7.2.3.1 application in production environment"} gitlab # [ 430.447611] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:31.314Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"} gitlab # [ 430.450001] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:31.315Z","message":"See LICENSE and the LGPL-3.0 for licensing details."} gitlab # [ 430.451868] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:31.315Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"} gitlab # [ 430.454116] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:31.318Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 431.350311] nixbot[3607]: INFO: ::ffff:127.0.0.1:40774 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.04 seconds) gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 432.406373] nixbot[3607]: INFO: ::ffff:127.0.0.1:40788 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 433.203659] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:34.069Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"18953c38a160f6ce580da1dc","created_at":"2026-08-20T05:58:59.942Z","trace_propagation_headers":{"sentry-trace":"309b2e9aca2c4dc69f3db3fac6691ab3-0a5f1ce955704e00","baggage":"sentry-trace_id=309b2e9aca2c4dc69f3db3fac6691ab3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0K6BTH9RNQNW6M41Q0Z8","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:00.012Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-18953c38a160f6ce580da1dc: start","job_status":"start","queue_duration_s":94.056358,"scheduling_latency_s":94.056464} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 433.465842] nixbot[3607]: INFO: ::ffff:127.0.0.1:40794 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 433.596975] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:34.463Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"18953c38a160f6ce580da1dc","created_at":"2026-08-20T05:58:59.942Z","trace_propagation_headers":{"sentry-trace":"309b2e9aca2c4dc69f3db3fac6691ab3-0a5f1ce955704e00","baggage":"sentry-trace_id=309b2e9aca2c4dc69f3db3fac6691ab3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0K6BTH9RNQNW6M41Q0Z8","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:00.012Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-18953c38a160f6ce580da1dc: done: 0.39459 sec","job_status":"done","queue_duration_s":94.056358,"scheduling_latency_s":94.056464,"redis_calls":23,"redis_duration_s":0.011253,"redis_read_bytes":910,"redis_write_bytes":2540,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.005825,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003131,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002297,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":9,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.204635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.2046607,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.39459,"completed_at":"2026-08-20T06:00:34.463Z","load_balancing_strategy":"primary","db_duration_s":0.110209,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 433.691766] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:34.466Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"82f7777d2a629a83e329f019","created_at":"2026-08-20T05:59:00.059Z","trace_propagation_headers":{"sentry-trace":"309b2e9aca2c4dc69f3db3fac6691ab3-0a5f1ce955704e00","baggage":"sentry-trace_id=309b2e9aca2c4dc69f3db3fac6691ab3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0K6BTH9RNQNW6M41Q0Z8","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:00.074Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-82f7777d2a629a83e329f019: start","job_status":"start","queue_duration_s":94.391914,"scheduling_latency_s":94.391955} gitlab # [ 433.781222] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:34.647Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"82f7777d2a629a83e329f019","created_at":"2026-08-20T05:59:00.059Z","trace_propagation_headers":{"sentry-trace":"309b2e9aca2c4dc69f3db3fac6691ab3-0a5f1ce955704e00","baggage":"sentry-trace_id=309b2e9aca2c4dc69f3db3fac6691ab3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0K6BTH9RNQNW6M41Q0Z8","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:00.074Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-82f7777d2a629a83e329f019: done: 0.181443 sec","job_status":"done","queue_duration_s":94.391914,"scheduling_latency_s":94.391955,"redis_calls":14,"redis_duration_s":0.005324000000000001,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.00101,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002609,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001705,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.134192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14073732,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.181443,"completed_at":"2026-08-20T06:00:34.647Z","load_balancing_strategy":"primary","db_duration_s":0.036914,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 433.869453] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:34.650Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"a0ef83fbb8ef93f48c4d5717","created_at":"2026-08-20T05:59:02.084Z","trace_propagation_headers":{"sentry-trace":"309b2e9aca2c4dc69f3db3fac6691ab3-0a5f1ce955704e00","baggage":"sentry-trace_id=309b2e9aca2c4dc69f3db3fac6691ab3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0K6BTH9RNQNW6M41Q0Z8","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:02.091Z","job_size_bytes":5,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-a0ef83fbb8ef93f48c4d5717: start","job_status":"start","queue_duration_s":92.558681,"scheduling_latency_s":92.558712} gitlab # [ 434.013802] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:34.880Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"a0ef83fbb8ef93f48c4d5717","created_at":"2026-08-20T05:59:02.084Z","trace_propagation_headers":{"sentry-trace":"309b2e9aca2c4dc69f3db3fac6691ab3-0a5f1ce955704e00","baggage":"sentry-trace_id=309b2e9aca2c4dc69f3db3fac6691ab3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0K6BTH9RNQNW6M41Q0Z8","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:02.091Z","job_size_bytes":5,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-a0ef83fbb8ef93f48c4d5717: done: 0.230201 sec","job_status":"done","queue_duration_s":92.558681,"scheduling_latency_s":92.558712,"redis_calls":12,"redis_duration_s":0.003922,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001048,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002253,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000621,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.178151,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00048496,"duration_s":0.230201,"completed_at":"2026-08-20T06:00:34.880Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.044121,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 434.118403] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:34.882Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"4d369b0fca7c0da9ceb62f37","created_at":"2026-08-20T05:59:02.129Z","trace_propagation_headers":{"sentry-trace":"309b2e9aca2c4dc69f3db3fac6691ab3-0a5f1ce955704e00","baggage":"sentry-trace_id=309b2e9aca2c4dc69f3db3fac6691ab3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0K6BTH9RNQNW6M41Q0Z8","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:02.135Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-4d369b0fca7c0da9ceb62f37: start","job_status":"start","queue_duration_s":92.747278,"scheduling_latency_s":92.7473} gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 434.416527] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:35.281Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"4d369b0fca7c0da9ceb62f37","created_at":"2026-08-20T05:59:02.129Z","trace_propagation_headers":{"sentry-trace":"309b2e9aca2c4dc69f3db3fac6691ab3-0a5f1ce955704e00","baggage":"sentry-trace_id=309b2e9aca2c4dc69f3db3fac6691ab3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0K6BTH9RNQNW6M41Q0Z8","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:02.135Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-4d369b0fca7c0da9ceb62f37: done: 0.399205 sec","job_status":"done","queue_duration_s":92.747278,"scheduling_latency_s":92.7473,"redis_calls":11,"redis_duration_s":0.0036969999999999998,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000821,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002185,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000691,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.35,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.35,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.046,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.273068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007931,"duration_s":0.399205,"completed_at":"2026-08-20T06:00:35.281Z","load_balancing_strategy":"primary","db_duration_s":0.136158,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 434.520695] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:35.285Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"bef4e9a76da0c9a905fcbd84","created_at":"2026-08-20T05:59:02.140Z","trace_propagation_headers":{"sentry-trace":"309b2e9aca2c4dc69f3db3fac6691ab3-0a5f1ce955704e00","baggage":"sentry-trace_id=309b2e9aca2c4dc69f3db3fac6691ab3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0K6BTH9RNQNW6M41Q0Z8","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:02.145Z","job_size_bytes":89,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-bef4e9a76da0c9a905fcbd84: start","job_status":"start","queue_duration_s":93.139326,"scheduling_latency_s":93.139362} gitlab # [ 434.552212] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:35.349Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"bef4e9a76da0c9a905fcbd84","created_at":"2026-08-20T05:59:02.140Z","trace_propagation_headers":{"sentry-trace":"309b2e9aca2c4dc69f3db3fac6691ab3-0a5f1ce955704e00","baggage":"sentry-trace_id=309b2e9aca2c4dc69f3db3fac6691ab3,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0K6BTH9RNQNW6M41Q0Z8","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:02.145Z","job_size_bytes":89,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-bef4e9a76da0c9a905fcbd84: done: 0.064345 sec","job_status":"done","queue_duration_s":93.139326,"scheduling_latency_s":93.139362,"redis_calls":11,"redis_duration_s":0.00417,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000996,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002437,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000737,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067852,"duration_s":0.064345,"completed_at":"2026-08-20T06:00:35.349Z","load_balancing_strategy":"primary","db_duration_s":0.009858,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 434.608613] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:35.351Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 f9e25abb020f765c8d7b6df0016c81ee0bc22174 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"fb512d03259bc63e17056194","created_at":"2026-08-20T05:59:05.028Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-6290e09ef482478f","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:59:05.068Z","job_size_bytes":185,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-fb512d03259bc63e17056194: start","job_status":"start","queue_duration_s":90.28373,"scheduling_latency_s":90.283761} gitlab # [ 434.626212] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:35.377Z","message":"changes: \"0000000000000000000000000000000000000000 f9e25abb020f765c8d7b6df0016c81ee0bc22174 refs/heads/master\\n\""} gitlab # [ 434.629083] gitaly[912]: time="2026-08-20T06:00:35.436Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:45.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:35.417" grpc.time_ms=18.786 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 434.643399] nixbot[3607]: INFO: ::ffff:127.0.0.1:40808 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab # [ 434.645533] gitaly[912]: time="2026-08-20T06:00:35.462Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:00:45.033" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:35.444" grpc.time_ms=17.856 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 434.684311] gitaly[912]: time="2026-08-20T06:00:35.551Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T06:00:45.123" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:35.533" grpc.time_ms=17.799 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 434.757497] gitaly[912]: time="2026-08-20T06:00:35.624Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3937 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:35.624" grpc.time_ms=0.783 pid=912 span.kind=server system=grpc gitlab # [ 434.808061] gitaly[912]: time="2026-08-20T06:00:35.675Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3939 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:35.673" grpc.time_ms=1.405 pid=912 span.kind=server system=grpc gitlab # [ 434.835848] gitaly[912]: time="2026-08-20T06:00:35.687Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 diskcache=4a3f2cd5-d869-4642-961e-9c6df8d888e6 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:00:45.163" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:35.573" pid=912 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 434.856695] gitaly[912]: time="2026-08-20T06:00:35.687Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=121 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5011 command.oublock=8 command.real_time_ms=107 command.spawn_token_fork_ms=1 command.system_time_ms=62 command.user_time_ms=59 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:00:45.163" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:35.573" grpc.time_ms=113.754 pid=912 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root gitlab # [ 434.877832] gitaly[912]: time="2026-08-20T06:00:35.719Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-08-20T06:00:45.008" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:35.719" grpc.time_ms=0.392 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 434.891794] gitaly[912]: time="2026-08-20T06:00:35.754Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=20 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=860 command.oublock=0 command.real_time_ms=24 command.spawn_token_fork_ms=3 command.system_time_ms=17 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-08-20T06:00:45.017" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:35.728" grpc.time_ms=26.509 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 435.091614] gitaly[912]: time="2026-08-20T06:00:35.958Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-08-20T06:01:05.045" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:35.945" grpc.time_ms=13.106 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 435.156894] gitaly[912]: time="2026-08-20T06:00:36.024Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:00:46.002" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:36.023" grpc.time_ms=0.608 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 435.189202] gitaly[912]: time="2026-08-20T06:00:36.041Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T06:00:46.008" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T06:00:36.029" grpc.time_ms=12.088 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 435.224499] gitaly[912]: time="2026-08-20T06:00:36.091Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:46.051" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:36.072" grpc.time_ms=18.768 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 435.260818] gitaly[912]: time="2026-08-20T06:00:36.123Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:46.083" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:36.103" grpc.time_ms=19.059 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 435.316091] gitaly[912]: time="2026-08-20T06:00:36.183Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=23 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=880 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=3 command.system_time_ms=23 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:01:06.051" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:36.152" grpc.time_ms=31.108 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.07 seconds) gitlab # [ 435.592419] nixbot[3607]: INFO: ::ffff:127.0.0.1:40814 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab # [ 436.080159] gitaly[912]: time="2026-08-20T06:00:36.946Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T06:00:46.232" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:36.943" grpc.time_ms=2.726 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.158078] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:37.023Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 f9e25abb020f765c8d7b6df0016c81ee0bc22174 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"fb512d03259bc63e17056194","created_at":"2026-08-20T05:59:05.028Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-6290e09ef482478f","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:59:05.068Z","job_size_bytes":185,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-fb512d03259bc63e17056194: done: 1.671388 sec","job_status":"done","queue_duration_s":90.28373,"scheduling_latency_s":90.283761,"gitaly_calls":13,"gitaly_duration_s":0.358976,"redis_calls":198,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.072312,"redis_read_bytes":2103,"redis_write_bytes":21750,"redis_cache_calls":15,"redis_cache_duration_s":0.007844,"redis_cache_read_bytes":20,"redis_cache_write_bytes":991,"redis_feature_flag_calls":27,"redis_feature_flag_duration_s":0.009412,"redis_feature_flag_read_bytes":1678,"redis_feature_flag_write_bytes":3082,"redis_queues_calls":10,"redis_queues_duration_s":0.002663,"redis_queues_read_bytes":10,"redis_queues_write_bytes":7838,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.005655,"redis_queues_metadata_read_bytes":13,"redis_queues_metadata_write_bytes":1467,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.027832,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.018906,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":47,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":47,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.098,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":47,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.341,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.396,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.098,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.154852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00089438,"exclusive_lock_hold_duration_s":0.046022579999999993,"duration_s":1.671388,"completed_at":"2026-08-20T06:00:37.023Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.173151,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 436.260799] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:37.026Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","f9e25abb020f765c8d7b6df0016c81ee0bc22174 592ba8e1ae809c278127a4883358e06e7303a2a1 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5a89a95a305f24a53692488d","created_at":"2026-08-20T05:59:10.701Z","trace_propagation_headers":{"sentry-trace":"be5d19a0df32442fa93cf968c0586b74-9b89c7a66b6f4077","baggage":"sentry-trace_id=be5d19a0df32442fa93cf968c0586b74,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0ZW47E5QZEGR9F67721T","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:59:10.708Z","job_size_bytes":185,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5a89a95a305f24a53692488d: start","job_status":"start","queue_duration_s":86.318369,"scheduling_latency_s":86.318411} gitlab # [ 436.280079] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:37.050Z","message":"changes: \"f9e25abb020f765c8d7b6df0016c81ee0bc22174 592ba8e1ae809c278127a4883358e06e7303a2a1 refs/heads/master\\n\""} gitlab # [ 436.282622] gitaly[912]: time="2026-08-20T06:00:37.101Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:47.062" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:37.082" grpc.time_ms=18.541 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.296481] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:37.139Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"df477668bac94b51255f894f","created_at":"2026-08-20T06:00:37.135Z","trace_propagation_headers":{"sentry-trace":"be5d19a0df32442fa93cf968c0586b74-b0ceec1f32b0411b","baggage":"sentry-trace_id=be5d19a0df32442fa93cf968c0586b74,sentry-release=Unknown"},"correlation_id":"01M0EW0ZW47E5QZEGR9F67721T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","duplicate-of":"79d6da6c7cbdcc194ddcf48e","job_size_bytes":46,"pid":3499,"job_status":"deduplicated","message":"ProjectCacheWorker JID-df477668bac94b51255f894f: deduplicated: until executing","deduplication.type":"until executing"} gitlab # [ 436.311769] gitaly[912]: time="2026-08-20T06:00:37.129Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-08-20T06:00:47.091" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:37.112" grpc.time_ms=16.739 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.325875] gitaly[912]: time="2026-08-20T06:00:37.191Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-08-20T06:00:47.152" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:37.172" grpc.time_ms=18.639 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.355164] gitaly[912]: time="2026-08-20T06:00:37.222Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-08-20T06:01:07.101" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:37.201" grpc.time_ms=20.34 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.399004] gitaly[912]: time="2026-08-20T06:00:37.259Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=320 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-08-20T06:00:47.227" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-08-20T06:00:37.247" grpc.time_ms=11.486 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.433293] gitaly[912]: time="2026-08-20T06:00:37.300Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:47.261" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:37.281" grpc.time_ms=18.706 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 436.646677] gitaly[912]: time="2026-08-20T06:00:37.513Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-08-20T06:00:47.100" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:37.510" grpc.time_ms=2.922 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 436.685726] nixbot[3607]: INFO: ::ffff:127.0.0.1:40826 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab # [ 436.703241] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:37.569Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","f9e25abb020f765c8d7b6df0016c81ee0bc22174 592ba8e1ae809c278127a4883358e06e7303a2a1 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"5a89a95a305f24a53692488d","created_at":"2026-08-20T05:59:10.701Z","trace_propagation_headers":{"sentry-trace":"be5d19a0df32442fa93cf968c0586b74-9b89c7a66b6f4077","baggage":"sentry-trace_id=be5d19a0df32442fa93cf968c0586b74,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW0ZW47E5QZEGR9F67721T","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-08-20T05:59:10.708Z","job_size_bytes":185,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-5a89a95a305f24a53692488d: done: 0.542404 sec","job_status":"done","queue_duration_s":86.318369,"scheduling_latency_s":86.318411,"gitaly_calls":7,"gitaly_duration_s":0.143007,"redis_calls":110,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.043290999999999996,"redis_read_bytes":500,"redis_write_bytes":11942,"redis_cache_calls":9,"redis_cache_duration_s":0.00462,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_queues_calls":6,"redis_queues_duration_s":0.002099,"redis_queues_read_bytes":8,"redis_queues_write_bytes":5719,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.006064,"redis_queues_metadata_read_bytes":163,"redis_queues_metadata_write_bytes":1428,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.014811,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.015697,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.05,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.05,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.349006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00168162,"exclusive_lock_hold_duration_s":0.0356635,"duration_s":0.542404,"completed_at":"2026-08-20T06:00:37.568Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.051022,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 436.803421] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:37.573Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"79963996105376b75abaa666","created_at":"2026-08-20T05:59:12.107Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-96a3efce15eb4e01","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:12.125Z","job_size_bytes":65,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-79963996105376b75abaa666: start","job_status":"start","queue_duration_s":85.447758,"scheduling_latency_s":85.44782} gitlab # [ 436.893418] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:37.759Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"79963996105376b75abaa666","created_at":"2026-08-20T05:59:12.107Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-96a3efce15eb4e01","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:12.125Z","job_size_bytes":65,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-79963996105376b75abaa666: done: 0.186282 sec","job_status":"done","queue_duration_s":85.447758,"scheduling_latency_s":85.44782,"redis_calls":16,"redis_duration_s":0.007248,"redis_read_bytes":269,"redis_write_bytes":1850,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.003535,"redis_feature_flag_read_bytes":262,"redis_feature_flag_write_bytes":1032,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002635,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.127899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00079744,"duration_s":0.186282,"completed_at":"2026-08-20T06:00:37.759Z","load_balancing_strategy":"primary","db_duration_s":0.043483,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 436.988817] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:37.764Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"fa59958fc897a167a2f71470","created_at":"2026-08-20T05:59:12.127Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-96a3efce15eb4e01","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:12.143Z","job_size_bytes":65,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-fa59958fc897a167a2f71470: start","job_status":"start","queue_duration_s":85.620609,"scheduling_latency_s":85.620655} gitlab # [ 437.252754] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:38.117Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"fa59958fc897a167a2f71470","created_at":"2026-08-20T05:59:12.127Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-96a3efce15eb4e01","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:12.143Z","job_size_bytes":65,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-fa59958fc897a167a2f71470: done: 0.353581 sec","job_status":"done","queue_duration_s":85.620609,"scheduling_latency_s":85.620655,"redis_calls":21,"redis_duration_s":0.008414999999999999,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003714,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002499,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002202,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":15,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.049,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.036,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.278312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00108658,"duration_s":0.353581,"completed_at":"2026-08-20T06:00:38.117Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.059224,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 437.352515] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:38.121Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d5ebbd7004bc74d867cbd76c","created_at":"2026-08-20T05:59:12.364Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-96a3efce15eb4e01","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:12.374Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d5ebbd7004bc74d867cbd76c: start","job_status":"start","queue_duration_s":85.746525,"scheduling_latency_s":85.746571} gitlab # [ 437.603720] gitaly[912]: time="2026-08-20T06:00:38.469Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:38.469" grpc.time_ms=0.814 pid=912 span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 437.655492] gitaly[912]: time="2026-08-20T06:00:38.522Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:38.522" grpc.time_ms=0.764 pid=912 span.kind=server system=grpc gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.06 seconds) gitlab # [ 437.704724] gitaly[912]: time="2026-08-20T06:00:38.572Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:38.571" grpc.time_ms=0.697 pid=912 span.kind=server system=grpc gitlab # [ 437.723845] nixbot[3607]: INFO: ::ffff:127.0.0.1:40838 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab # [ 437.727702] gitaly[912]: time="2026-08-20T06:00:38.591Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 diskcache=8ca8e8ef-f16a-4eff-a66d-b6aa0ff07873 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:01:08.308" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:38.409" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 437.745101] gitaly[912]: time="2026-08-20T06:00:38.591Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=193 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7539 command.oublock=0 command.real_time_ms=173 command.spawn_token_fork_ms=1 command.system_time_ms=102 command.user_time_ms=91 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:01:08.308" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:38.409" grpc.time_ms=181.995 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 437.933077] gitaly[912]: time="2026-08-20T06:00:38.800Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:01:08.697" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:38.798" grpc.time_ms=2.044 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 438.024349] gitaly[912]: time="2026-08-20T06:00:38.891Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW119Z9EVDPFSRCYJNSNF5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:08.789" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:38.890" grpc.time_ms=1.235 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 438.081332] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:38.947Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"d5ebbd7004bc74d867cbd76c","created_at":"2026-08-20T05:59:12.364Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-96a3efce15eb4e01","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T05:59:12.374Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-d5ebbd7004bc74d867cbd76c: done: 0.826365 sec","job_status":"done","queue_duration_s":85.746525,"scheduling_latency_s":85.746571,"gitaly_calls":3,"gitaly_duration_s":0.202216,"redis_calls":117,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.045226,"redis_read_bytes":457,"redis_write_bytes":27998,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002215,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.003317,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_feature_flag_calls":40,"redis_feature_flag_duration_s":0.015459,"redis_feature_flag_read_bytes":294,"redis_feature_flag_write_bytes":6581,"redis_queues_calls":25,"redis_queues_duration_s":0.005583,"redis_queues_read_bytes":36,"redis_queues_write_bytes":14492,"redis_queues_metadata_calls":21,"redis_queues_metadata_duration_s":0.010374,"redis_queues_metadata_read_bytes":32,"redis_queues_metadata_write_bytes":3370,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.001109,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000835,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.004119,"redis_shared_state_read_bytes":11,"redis_shared_state_write_bytes":851,"db_count":52,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":52,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.112,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":17,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.042,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.05,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.055,"db_ci_duration_s":0.057,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.475343,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.6842372800000001,"duration_s":0.826365,"completed_at":"2026-08-20T06:00:38.947Z","load_balancing_strategy":"primary","db_duration_s":0.134875,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 438.151246] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:38.951Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"79d6da6c7cbdcc194ddcf48e","created_at":"2026-08-20T06:00:35.466Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-1ab4f3a7a8044739","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:35.493Z","job_size_bytes":46,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-79d6da6c7cbdcc194ddcf48e: start","job_status":"start","queue_duration_s":3.458133,"scheduling_latency_s":3.458188} gitlab # [ 438.196512] gitaly[912]: time="2026-08-20T06:00:39.063Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-08-20T12:00:39.050" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:39.051" grpc.time_ms=11.538 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 438.222457] gitaly[912]: time="2026-08-20T06:00:39.089Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T06:01:09.077" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:39.078" grpc.time_ms=11.18 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 438.277040] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:39.142Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"79d6da6c7cbdcc194ddcf48e","created_at":"2026-08-20T06:00:35.466Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-1ab4f3a7a8044739","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:35.493Z","job_size_bytes":46,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-79d6da6c7cbdcc194ddcf48e: done: 0.191053 sec","job_status":"done","queue_duration_s":3.458133,"scheduling_latency_s":3.458188,"gitaly_calls":2,"gitaly_duration_s":0.032015,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.012589,"redis_read_bytes":69,"redis_write_bytes":4878,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002483,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000803,"redis_queues_read_bytes":4,"redis_queues_write_bytes":2111,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002894,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.004966,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":748,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001443,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.122486,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043454,"duration_s":0.191053,"completed_at":"2026-08-20T06:00:39.142Z","load_balancing_strategy":"primary","db_duration_s":0.026621,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 438.368075] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:39.145Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"dc55ed2fc4d5c99110b967cd","created_at":"2026-08-20T06:00:35.520Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-1ab4f3a7a8044739","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:35.527Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-dc55ed2fc4d5c99110b967cd: start","job_status":"start","queue_duration_s":3.617831,"scheduling_latency_s":3.617869} gitlab # [ 438.398540] gitaly[912]: time="2026-08-20T06:00:39.229Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 diskcache=e02b1930-17eb-4532-bcb9-65839ef5ba2a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:00:39.195" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:39.196" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 438.413491] gitaly[912]: time="2026-08-20T06:00:39.230Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1174 command.oublock=0 command.real_time_ms=37 command.spawn_token_fork_ms=3 command.system_time_ms=12 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:00:39.195" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:39.196" grpc.time_ms=33.143 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 438.450545] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:39.317Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"dc55ed2fc4d5c99110b967cd","created_at":"2026-08-20T06:00:35.520Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-1ab4f3a7a8044739","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:35.527Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-dc55ed2fc4d5c99110b967cd: done: 0.17196 sec","job_status":"done","queue_duration_s":3.617831,"scheduling_latency_s":3.617869,"gitaly_calls":1,"gitaly_duration_s":0.039101,"redis_calls":15,"redis_duration_s":0.007032,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001026,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001929,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.002176,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001901,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.023,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.046,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.094313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12854933999999998,"duration_s":0.17196,"completed_at":"2026-08-20T06:00:39.317Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.036595,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 438.510945] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:39.321Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"ed08a135007e37eaa0f7ab85","created_at":"2026-08-20T06:00:35.709Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-1ab4f3a7a8044739","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:35.714Z","job_size_bytes":23,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ed08a135007e37eaa0f7ab85: start","job_status":"start","queue_duration_s":3.606868,"scheduling_latency_s":3.606908} gitlab # [ 438.529069] gitaly[912]: time="2026-08-20T06:00:39.388Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=596 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-08-20T06:01:09.375" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:39.376" grpc.time_ms=12.182 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 438.544164] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:39.409Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"ed08a135007e37eaa0f7ab85","created_at":"2026-08-20T06:00:35.709Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-1ab4f3a7a8044739","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:35.714Z","job_size_bytes":23,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-ed08a135007e37eaa0f7ab85: done: 0.08864 sec","job_status":"done","queue_duration_s":3.606868,"scheduling_latency_s":3.606908,"gitaly_calls":1,"gitaly_duration_s":0.016223,"redis_calls":16,"redis_duration_s":0.009276,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.000575,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003734,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.003592,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001375,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055629,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.08864,"completed_at":"2026-08-20T06:00:39.409Z","load_balancing_strategy":"primary","db_duration_s":0.007331,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 438.601761] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:39.412Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d43acdb3b57c70568e5b6329","created_at":"2026-08-20T06:00:36.646Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-1ab4f3a7a8044739","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c30e3e705e8b61d8f0147fb6cb80ce79554bf48b4abab3a95e63a1ea07c04268","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.660Z","job_size_bytes":467,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d43acdb3b57c70568e5b6329: start","job_status":"start","queue_duration_s":2.751992,"scheduling_latency_s":2.752036} gitlab # [ 438.626665] gitaly[912]: time="2026-08-20T06:00:39.464Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:09.463" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:39.463" grpc.time_ms=0.858 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 438.643479] gitaly[912]: time="2026-08-20T06:00:39.492Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:00:49.003" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:39.474" grpc.time_ms=17.822 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 438.783480] nixbot[3607]: INFO: ::ffff:127.0.0.1:40850 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.07 seconds) gitlab # [ 438.806536] gitaly[912]: time="2026-08-20T06:00:39.674Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:01:09.672" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:39.672" grpc.time_ms=1.039 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 438.823707] gitaly[912]: time="2026-08-20T06:00:39.689Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=33 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T06:01:09.683" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:39.684" grpc.time_ms=4.761 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 439.033566] gitaly[912]: time="2026-08-20T06:00:39.900Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:49.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:39.880" grpc.time_ms=20.379 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 439.848078] nixbot[3607]: INFO: ::ffff:127.0.0.1:40862 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.07 seconds) gitlab # [ 440.062285] gitaly[912]: time="2026-08-20T06:00:40.929Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:01:10.809" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:40.910" grpc.time_ms=19.117 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 440.082433] gitaly[912]: time="2026-08-20T06:00:40.949Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0SXJ0D04HH34SAS9F8R6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T06:01:10.834" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:40.934" grpc.time_ms=14.825 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 440.125981] sidekiq-cluster[3499]: {"severity":"WARN","time":"2026-08-20T06:00:40.992Z","class":"CreatePipelineWorker","correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"f9e25abb020f765c8d7b6df0016c81ee0bc22174","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"f9e25abb020f765c8d7b6df0016c81ee0bc22174","ref":"refs/heads/master"},"retry":0} gitlab # [ 440.136474] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:41.003Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"d43acdb3b57c70568e5b6329","created_at":"2026-08-20T06:00:36.646Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-1ab4f3a7a8044739","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c30e3e705e8b61d8f0147fb6cb80ce79554bf48b4abab3a95e63a1ea07c04268","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.660Z","job_size_bytes":467,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-d43acdb3b57c70568e5b6329: done: 1.59082 sec","job_status":"done","queue_duration_s":2.751992,"scheduling_latency_s":2.752036,"gitaly_calls":7,"gitaly_duration_s":0.113827,"redis_calls":51,"redis_duration_s":0.018038,"redis_read_bytes":169,"redis_write_bytes":4168,"redis_cache_calls":4,"redis_cache_duration_s":0.001702,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":16,"redis_feature_flag_duration_s":0.006893,"redis_feature_flag_read_bytes":16,"redis_feature_flag_write_bytes":2174,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004846,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001509,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":36,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":36,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":32,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.042,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.391703,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00042774,"duration_s":1.59082,"completed_at":"2026-08-20T06:00:41.003Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.086583,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 440.200851] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:41.005Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"28f25bcf-6d58-42ce-941a-9da75aa1169c\"}"],"class":"WebHookWorker","jid":"d4ed48ea3bb60c49178268f3","created_at":"2026-08-20T06:00:36.895Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-1ab4f3a7a8044739","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:872b5cdf9ed81c33e0ee60c5f9c20449b93a91751ffe3fa810540d755764e688","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.903Z","job_size_bytes":1751,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-d4ed48ea3bb60c49178268f3: start","job_status":"start","queue_duration_s":4.102006,"scheduling_latency_s":4.10204} gitlab # [ 440.295931] nixbot[3607]: INFO: ::ffff:127.0.0.1:40872 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 440.358336] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:41.222Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"28f25bcf-6d58-42ce-941a-9da75aa1169c\"}"],"class":"WebHookWorker","jid":"d4ed48ea3bb60c49178268f3","created_at":"2026-08-20T06:00:36.895Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-1ab4f3a7a8044739","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:872b5cdf9ed81c33e0ee60c5f9c20449b93a91751ffe3fa810540d755764e688","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:36.903Z","job_size_bytes":1751,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-d4ed48ea3bb60c49178268f3: done: 0.216929 sec","job_status":"done","queue_duration_s":4.102006,"scheduling_latency_s":4.10204,"redis_calls":19,"redis_duration_s":0.034709,"redis_read_bytes":32,"redis_write_bytes":5368,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001588,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000484,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3730,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003312,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.029325,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.04780003999997007,"cpu_s":0.131674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00113248,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.216929,"completed_at":"2026-08-20T06:00:41.222Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004741,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 440.485223] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:41.225Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5ed232c695e907c94a3f1d5c","created_at":"2026-08-20T06:00:37.154Z","trace_propagation_headers":{"sentry-trace":"be5d19a0df32442fa93cf968c0586b74-b0ceec1f32b0411b","baggage":"sentry-trace_id=be5d19a0df32442fa93cf968c0586b74,sentry-release=Unknown"},"correlation_id":"01M0EW0ZW47E5QZEGR9F67721T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"dc55ed2fc4d5c99110b967cd","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:37.161Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5ed232c695e907c94a3f1d5c: start","job_status":"start","queue_duration_s":4.064444,"scheduling_latency_s":4.064484} gitlab # [ 440.509437] gitaly[912]: time="2026-08-20T06:00:41.320Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T diskcache=403ab478-1d25-47f3-a9b2-38dbe10f99d5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:00:41.304" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:41.305" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 440.523458] gitaly[912]: time="2026-08-20T06:00:41.320Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=291 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=5 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-08-20T12:00:41.304" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:41.305" grpc.time_ms=15.234 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 440.542537] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:41 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 136 gitlab # [ 440.545700] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:41.360Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"5ed232c695e907c94a3f1d5c","created_at":"2026-08-20T06:00:37.154Z","trace_propagation_headers":{"sentry-trace":"be5d19a0df32442fa93cf968c0586b74-b0ceec1f32b0411b","baggage":"sentry-trace_id=be5d19a0df32442fa93cf968c0586b74,sentry-release=Unknown"},"correlation_id":"01M0EW0ZW47E5QZEGR9F67721T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","duplicate-of":"dc55ed2fc4d5c99110b967cd","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:37.161Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-5ed232c695e907c94a3f1d5c: done: 0.134744 sec","job_status":"done","queue_duration_s":4.064444,"scheduling_latency_s":4.064484,"gitaly_calls":1,"gitaly_duration_s":0.018913,"redis_calls":12,"redis_duration_s":0.016934,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003808,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.004504,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.008622,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05347,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06032794,"duration_s":0.134744,"completed_at":"2026-08-20T06:00:41.360Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016857,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 440.607937] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:41.363Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"86a41f9a6830b35c84035de5","created_at":"2026-08-20T06:00:37.420Z","trace_propagation_headers":{"sentry-trace":"be5d19a0df32442fa93cf968c0586b74-b0ceec1f32b0411b","baggage":"sentry-trace_id=be5d19a0df32442fa93cf968c0586b74,sentry-release=Unknown"},"correlation_id":"01M0EW0ZW47E5QZEGR9F67721T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:06574aae5bc372ba807027833a709891f1ad15987e2e3d73d2de0f14ca3e5557","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:37.427Z","job_size_bytes":467,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-86a41f9a6830b35c84035de5: start","job_status":"start","queue_duration_s":3.936479,"scheduling_latency_s":3.936517} gitlab # [ 440.630982] gitaly[912]: time="2026-08-20T06:00:41.369Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3S0HD10FCCZCW5RPHK1X grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:41.358" grpc.time_ms=11.078 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 440.651173] gitaly[912]: time="2026-08-20T06:00:41.413Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:11.411" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:41.412" grpc.time_ms=0.843 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 440.668377] gitlab-workhorse[819]: time="2026-08-20T06:00:41Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 440.670362] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:41 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 131 gitlab # [ 440.673231] gitaly[912]: time="2026-08-20T06:00:41.426Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:00:51.006" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:41.417" grpc.time_ms=8.928 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 440.691649] nixbot[3607]: {"ts": "2026-08-20T06:00:41.536Z", "level": "info", "logger": "nixbot.build_reuse", "msg": "reusing build for tree hash", "build_id": 1, "tree_hash": "a8c90de643fa3b1e78fc9dc27f18f04a936ba912"} gitlab # [ 440.695439] gitaly[912]: time="2026-08-20T06:00:41.494Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:01:11.492" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:41.493" grpc.time_ms=1.146 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 440.712982] gitaly[912]: time="2026-08-20T06:00:41.503Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3S4XT3D16S81WH1J0AS9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:41.491" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 440.726771] gitaly[912]: time="2026-08-20T06:00:41.504Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3S4XT3D16S81WH1J0AS9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:41.491" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 440.745543] gitaly[912]: time="2026-08-20T06:00:41.504Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3S4XT3D16S81WH1J0AS9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:41.491" grpc.time_ms=13.12 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 440.765699] gitaly[912]: time="2026-08-20T06:00:41.506Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=179 command.oublock=0 command.real_time_ms=3 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-08-20T06:01:11.501" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:41.502" grpc.time_ms=4.138 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 440.787602] gitaly[912]: time="2026-08-20T06:00:41.577Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:51.096" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:41.567" grpc.time_ms=10.45 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 440.885432] nixbot[3607]: INFO: ::ffff:127.0.0.1:56898 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.03 seconds) gitlab # [ 440.960840] gitaly[912]: time="2026-08-20T06:00:41.828Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3SAG6MN132SCXPRHS3EX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:11.426" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:41.827" grpc.time_ms=0.778 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.181036] gitaly[912]: time="2026-08-20T06:00:42.047Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3SAG6MN132SCXPRHS3EX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:52.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:42.038" grpc.time_ms=9.249 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.343445] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 HTTP/1.1" 201 657 "" "python-httpx/0.28.1" 657 gitlab # [ 441.346626] nixbot[3607]: {"ts": "2026-08-20T06:00:42.212Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 \"HTTP/1.1 201 Created\""} gitlab # [ 441.468259] gitaly[912]: time="2026-08-20T06:00:42.333Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3SZ8VDRTXDNQS0BPDKPW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:12.330" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:42.331" grpc.time_ms=0.884 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.521815] gitaly[912]: time="2026-08-20T06:00:42.389Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=5 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-08-20T06:01:12.372" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:42.372" grpc.time_ms=16.682 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.561524] gitaly[912]: time="2026-08-20T06:00:42.429Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW0ZW47E5QZEGR9F67721T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-08-20T06:01:12.411" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:42.411" grpc.time_ms=17.423 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.580784] gitaly[912]: time="2026-08-20T06:00:42.439Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3SZ8VDRTXDNQS0BPDKPW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:52.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:42.429" grpc.time_ms=9.463 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.599688] sidekiq-cluster[3499]: {"severity":"WARN","time":"2026-08-20T06:00:42.451Z","class":"CreatePipelineWorker","correlation_id":"01M0EW0ZW47E5QZEGR9F67721T","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"f9e25abb020f765c8d7b6df0016c81ee0bc22174","after":"592ba8e1ae809c278127a4883358e06e7303a2a1","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"592ba8e1ae809c278127a4883358e06e7303a2a1","ref":"refs/heads/master"},"retry":0} gitlab # [ 441.609903] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:42.457Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"86a41f9a6830b35c84035de5","created_at":"2026-08-20T06:00:37.420Z","trace_propagation_headers":{"sentry-trace":"be5d19a0df32442fa93cf968c0586b74-b0ceec1f32b0411b","baggage":"sentry-trace_id=be5d19a0df32442fa93cf968c0586b74,sentry-release=Unknown"},"correlation_id":"01M0EW0ZW47E5QZEGR9F67721T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:06574aae5bc372ba807027833a709891f1ad15987e2e3d73d2de0f14ca3e5557","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:37.427Z","job_size_bytes":467,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-86a41f9a6830b35c84035de5: done: 1.094097 sec","job_status":"done","queue_duration_s":3.936479,"scheduling_latency_s":3.936517,"gitaly_calls":7,"gitaly_duration_s":0.104885,"redis_calls":33,"redis_duration_s":0.010121,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000877,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00385,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003987,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001407,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":27,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":24,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.039,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.951006,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.094097,"completed_at":"2026-08-20T06:00:42.457Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042466,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 441.672351] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:42.459Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"85ec98d0-c9e1-4ca3-be0f-4b905c35f924\"}"],"class":"WebHookWorker","jid":"e5549f2196d0341203de0ec2","created_at":"2026-08-20T06:00:37.469Z","trace_propagation_headers":{"sentry-trace":"be5d19a0df32442fa93cf968c0586b74-b0ceec1f32b0411b","baggage":"sentry-trace_id=be5d19a0df32442fa93cf968c0586b74,sentry-release=Unknown"},"correlation_id":"01M0EW0ZW47E5QZEGR9F67721T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7b261b4a10edde182838eb0b5a8d394098a30e4edda6c722aded44f211a37338","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:37.476Z","job_size_bytes":1749,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e5549f2196d0341203de0ec2: start","job_status":"start","queue_duration_s":4.983359,"scheduling_latency_s":4.983387} gitlab # [ 441.697870] nixbot[3607]: INFO: ::ffff:127.0.0.1:56908 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted gitlab # [ 441.699700] nixbot[3607]: {"ts": "2026-08-20T06:00:42.564Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 \"HTTP/1.1 201 Created\""} gitlab # [ 441.704292] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:42 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 343 gitlab # [ 441.707992] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:42.567Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"85ec98d0-c9e1-4ca3-be0f-4b905c35f924\"}"],"class":"WebHookWorker","jid":"e5549f2196d0341203de0ec2","created_at":"2026-08-20T06:00:37.469Z","trace_propagation_headers":{"sentry-trace":"be5d19a0df32442fa93cf968c0586b74-b0ceec1f32b0411b","baggage":"sentry-trace_id=be5d19a0df32442fa93cf968c0586b74,sentry-release=Unknown"},"correlation_id":"01M0EW0ZW47E5QZEGR9F67721T","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7b261b4a10edde182838eb0b5a8d394098a30e4edda6c722aded44f211a37338","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:37.476Z","job_size_bytes":1749,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-e5549f2196d0341203de0ec2: done: 0.107737 sec","job_status":"done","queue_duration_s":4.983359,"scheduling_latency_s":4.983387,"redis_calls":14,"redis_duration_s":0.010191,"redis_read_bytes":26,"redis_write_bytes":4683,"redis_queues_calls":2,"redis_queues_duration_s":0.000492,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3727,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005933,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003766,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":326,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.020867180000038843,"cpu_s":0.042253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","extra.web_hook_worker.signing_token_present":false,"duration_s":0.107737,"completed_at":"2026-08-20T06:00:42.567Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 441.769650] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:42.576Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cd25f61a034efc7eee0ffaf2","created_at":"2026-08-20T06:00:38.376Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.386Z","job_size_bytes":23,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cd25f61a034efc7eee0ffaf2: start","job_status":"start","queue_duration_s":4.18956,"scheduling_latency_s":4.189608} gitlab # [ 441.810969] gitaly[912]: time="2026-08-20T06:00:42.678Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3TAJGBCX2C2G9F2EJR20 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=185 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:42.668" grpc.time_ms=10.282 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 441.830181] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:42 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 100 gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 441.884749] gitaly[912]: time="2026-08-20T06:00:42.752Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3TAWWGMBVYV7M4F7XD5B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:12.347" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:42.751" grpc.time_ms=0.834 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 441.933397] nixbot[3607]: INFO: ::ffff:127.0.0.1:56914 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) gitlab # [ 441.953847] gitaly[912]: time="2026-08-20T06:00:42.821Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3TDVHMEMND61M3Z0ZVF8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:42.802" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 441.968455] gitaly[912]: time="2026-08-20T06:00:42.821Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3TDVHMEMND61M3Z0ZVF8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:42.802" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 441.986351] gitlab-workhorse[819]: time="2026-08-20T06:00:42Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 441.989111] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:42 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 139 gitlab # [ 441.991851] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:42.840Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"cd25f61a034efc7eee0ffaf2","created_at":"2026-08-20T06:00:38.376Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.386Z","job_size_bytes":23,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-cd25f61a034efc7eee0ffaf2: done: 0.26418 sec","job_status":"done","queue_duration_s":4.18956,"scheduling_latency_s":4.189608,"redis_calls":10,"redis_duration_s":0.012202,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.005437,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006077,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000688,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":15,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.04,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.011,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.144714,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038306,"duration_s":0.26418,"completed_at":"2026-08-20T06:00:42.840Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.052229,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 442.052832] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:42.847Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"28623672fdbd7997b4ccf1c7","created_at":"2026-08-20T06:00:38.603Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.615Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-28623672fdbd7997b4ccf1c7: start","job_status":"start","queue_duration_s":4.231451,"scheduling_latency_s":4.231494} gitlab # [ 442.075848] gitaly[912]: time="2026-08-20T06:00:42.821Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=4 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3TDVHMEMND61M3Z0ZVF8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:42.802" grpc.time_ms=19.666 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 442.101558] nix-daemon[3831]: accepted connection from pid 4400, user nixbot gitlab # [ 442.103224] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:42.950Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"28623672fdbd7997b4ccf1c7","created_at":"2026-08-20T06:00:38.603Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.615Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-28623672fdbd7997b4ccf1c7: done: 0.103054 sec","job_status":"done","queue_duration_s":4.231451,"scheduling_latency_s":4.231494,"redis_calls":10,"redis_duration_s":0.011991,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000996,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009579,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001416,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0010546,"duration_s":0.103054,"completed_at":"2026-08-20T06:00:42.950Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.165994] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:42.963Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"82f65bd657a08d32c472a23e","created_at":"2026-08-20T06:00:38.644Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.655Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-82f65bd657a08d32c472a23e: start","job_status":"start","queue_duration_s":4.3082,"scheduling_latency_s":4.308246} gitlab # [ 442.190087] gitaly[912]: time="2026-08-20T06:00:42.851Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3TAWWGMBVYV7M4F7XD5B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:52.010" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:42.841" grpc.time_ms=10.12 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 442.209591] nixbot[3607]: {"ts": "2026-08-20T06:00:43.026Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 \"HTTP/1.1 201 Created\""} gitlab # [ 442.213690] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.052Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"82f65bd657a08d32c472a23e","created_at":"2026-08-20T06:00:38.644Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.655Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-82f65bd657a08d32c472a23e: done: 0.089258 sec","job_status":"done","queue_duration_s":4.3082,"scheduling_latency_s":4.308246,"redis_calls":10,"redis_duration_s":0.004528,"redis_read_bytes":9,"redis_write_bytes":1205,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001528,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002146,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000854,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":9,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057111,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047422,"duration_s":0.089258,"completed_at":"2026-08-20T06:00:43.052Z","load_balancing_strategy":"primary","db_duration_s":0.013244,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.271939] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.055Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1414e3243e8d85fc23d34b38","created_at":"2026-08-20T06:00:38.686Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.695Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1414e3243e8d85fc23d34b38: start","job_status":"start","queue_duration_s":4.360258,"scheduling_latency_s":4.360295} gitlab # [ 442.294853] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:43 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/f9e25abb020f765c8d7b6df0016c81ee0bc22174 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 436 gitlab # [ 442.298494] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 162 gitlab # [ 442.301578] gitlab-workhorse[819]: time="2026-08-20T06:00:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 442.304266] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 120 gitlab # [ 442.306992] gitaly[912]: time="2026-08-20T06:00:43.030Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=5 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3TKM82DBPPBGA7C5E9ET grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:43.012" grpc.time_ms=17.734 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 442.325482] gitaly[912]: time="2026-08-20T06:00:43.155Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3TRWKKVHMH6M9AGSYD06 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:43.137" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 442.338917] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.152Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"1414e3243e8d85fc23d34b38","created_at":"2026-08-20T06:00:38.686Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.695Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-1414e3243e8d85fc23d34b38: done: 0.096814 sec","job_status":"done","queue_duration_s":4.360258,"scheduling_latency_s":4.360295,"redis_calls":13,"redis_duration_s":0.011486,"redis_read_bytes":66,"redis_write_bytes":1182,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000819,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005002,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.004831,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000834,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.055756,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00101672,"duration_s":0.096814,"completed_at":"2026-08-20T06:00:43.152Z","load_balancing_strategy":"primary","db_duration_s":0.014212,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.403450] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.156Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1080353b9f96a63b3c8f220d","created_at":"2026-08-20T06:00:38.696Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.704Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1080353b9f96a63b3c8f220d: start","job_status":"start","queue_duration_s":4.452012,"scheduling_latency_s":4.452052} gitlab # [ 442.426974] gitaly[912]: time="2026-08-20T06:00:43.156Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=11 command.system_time_ms=0 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3TRWKKVHMH6M9AGSYD06 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:43.137" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 442.447053] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.245Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"1080353b9f96a63b3c8f220d","created_at":"2026-08-20T06:00:38.696Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.704Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-1080353b9f96a63b3c8f220d: done: 0.089351 sec","job_status":"done","queue_duration_s":4.452012,"scheduling_latency_s":4.452052,"redis_calls":10,"redis_duration_s":0.006056000000000001,"redis_read_bytes":9,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000715,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004061,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00128,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053611,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031672,"duration_s":0.089351,"completed_at":"2026-08-20T06:00:43.245Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016666,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.512075] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.247Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"89353f775f91987431abad8c","created_at":"2026-08-20T06:00:38.705Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.716Z","job_size_bytes":19,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-89353f775f91987431abad8c: start","job_status":"start","queue_duration_s":4.53129,"scheduling_latency_s":4.531317} gitlab # [ 442.534635] gitaly[912]: time="2026-08-20T06:00:43.156Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=11 command.system_time_ms=0 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3TRWKKVHMH6M9AGSYD06 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:43.137" grpc.time_ms=19.41 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 442.556034] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:43 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 110 gitlab # [ 442.559231] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.294Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"89353f775f91987431abad8c","created_at":"2026-08-20T06:00:38.705Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.716Z","job_size_bytes":19,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-89353f775f91987431abad8c: done: 0.047058 sec","job_status":"done","queue_duration_s":4.53129,"scheduling_latency_s":4.531317,"redis_calls":11,"redis_duration_s":0.0023020000000000002,"redis_read_bytes":10,"redis_write_bytes":1121,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000385,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001513,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":640,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000404,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":194,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00047246,"duration_s":0.047058,"completed_at":"2026-08-20T06:00:43.294Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007695,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.624949] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.296Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7418a967cd8321e6b73ba80b","created_at":"2026-08-20T06:00:38.720Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.727Z","job_size_bytes":66,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7418a967cd8321e6b73ba80b: start","job_status":"start","queue_duration_s":4.569195,"scheduling_latency_s":4.569225} gitlab # [ 442.654032] gitaly[912]: time="2026-08-20T06:00:43.319Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3TY8QCSG3P4BCPKPKH22 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:43.305" grpc.time_ms=13.792 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 442.674595] gitaly[912]: time="2026-08-20T06:00:43.444Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3V1STXQHVTFCR0JEHWCG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:43.419" pid=912 remote_ip="2001:db8:1::1" request_sha=22300437632a556c435888000544c7c9bb3428e9 response_bytes=216 span.kind=server system=grpc gitlab # [ 442.694442] gitlab-workhorse[819]: time="2026-08-20T06:00:43Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=216 gitlab # [ 442.697468] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:43 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 216 "" "git/2.55.0" 123 gitlab # [ 442.700827] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.353Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"7418a967cd8321e6b73ba80b","created_at":"2026-08-20T06:00:38.720Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.727Z","job_size_bytes":66,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-7418a967cd8321e6b73ba80b: done: 0.056419 sec","job_status":"done","queue_duration_s":4.569195,"scheduling_latency_s":4.569225,"redis_calls":10,"redis_duration_s":0.002349,"redis_read_bytes":9,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000494,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":335,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001368,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000487,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044002,"duration_s":0.056419,"completed_at":"2026-08-20T06:00:43.352Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009236,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.757066] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.355Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"45ecbaa2198f447b145376db","created_at":"2026-08-20T06:00:38.728Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.736Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-45ecbaa2198f447b145376db: start","job_status":"start","queue_duration_s":4.618515,"scheduling_latency_s":4.61855} gitlab # [ 442.779543] gitaly[912]: time="2026-08-20T06:00:43.444Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3V1STXQHVTFCR0JEHWCG grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:43.419" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 442.797780] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.479Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"45ecbaa2198f447b145376db","created_at":"2026-08-20T06:00:38.728Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.736Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-45ecbaa2198f447b145376db: done: 0.124534 sec","job_status":"done","queue_duration_s":4.618515,"scheduling_latency_s":4.61855,"redis_calls":10,"redis_duration_s":0.003041,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000718,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000578,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":10,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081433,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00059012,"duration_s":0.124534,"completed_at":"2026-08-20T06:00:43.479Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.858466] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.487Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"aa1074a63added84acb20824","created_at":"2026-08-20T06:00:38.745Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.750Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-aa1074a63added84acb20824: start","job_status":"start","queue_duration_s":4.736674,"scheduling_latency_s":4.736719} gitlab # [ 442.882767] gitaly[912]: time="2026-08-20T06:00:43.444Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1102 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3V1STXQHVTFCR0JEHWCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:43.419" grpc.time_ms=25.291 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1' gitlab # [ 442.902451] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.573Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"aa1074a63added84acb20824","created_at":"2026-08-20T06:00:38.745Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.750Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-aa1074a63added84acb20824: done: 0.086847 sec","job_status":"done","queue_duration_s":4.736674,"scheduling_latency_s":4.736719,"redis_calls":10,"redis_duration_s":0.008291,"redis_read_bytes":9,"redis_write_bytes":1023,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002134,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004452,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001705,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":198,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.012,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0508,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0018283,"duration_s":0.086847,"completed_at":"2026-08-20T06:00:43.573Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020577,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 442.961839] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.579Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6aea112b3c07004bf798e78d","created_at":"2026-08-20T06:00:38.751Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.755Z","job_size_bytes":6,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6aea112b3c07004bf798e78d: start","job_status":"start","queue_duration_s":4.823703,"scheduling_latency_s":4.823745} gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1', in 0.05 seconds) (finished: subtest: push delivers the webhook, in 94.23 seconds) subtest: eval and build post commit statuses gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses gitlab # [ 442.984767] gitaly[912]: time="2026-08-20T06:00:43.608Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3V7J56QF527GQ2N02EV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:13.605" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:43.606" grpc.time_ms=2.114 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.002503] nixbot[3607]: INFO: ::ffff:127.0.0.1:56926 - "GET /api/repos/gitlab/root/test-flake/builds?commit=592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 200 OK gitlab # [ 443.005440] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.642Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"6aea112b3c07004bf798e78d","created_at":"2026-08-20T06:00:38.751Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.755Z","job_size_bytes":6,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-6aea112b3c07004bf798e78d: done: 0.06252 sec","job_status":"done","queue_duration_s":4.823703,"scheduling_latency_s":4.823745,"redis_calls":10,"redis_duration_s":0.017312,"redis_read_bytes":9,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006154,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.009812,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001346,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062624,"duration_s":0.06252,"completed_at":"2026-08-20T06:00:43.641Z","load_balancing_strategy":"primary","db_duration_s":0.006348,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.064101] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.645Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e280b7be3d784aaeff2ed952","created_at":"2026-08-20T06:00:38.756Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.762Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e280b7be3d784aaeff2ed952: start","job_status":"start","queue_duration_s":4.883135,"scheduling_latency_s":4.883168} gitlab # [ 443.086258] gitaly[912]: time="2026-08-20T06:00:43.637Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=591 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3V7J56QF527GQ2N02EV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-08-20T06:01:13.625" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:43.626" grpc.time_ms=11.428 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.104389] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.738Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"e280b7be3d784aaeff2ed952","created_at":"2026-08-20T06:00:38.756Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.762Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-e280b7be3d784aaeff2ed952: done: 0.09322 sec","job_status":"done","queue_duration_s":4.883135,"scheduling_latency_s":4.883168,"redis_calls":10,"redis_duration_s":0.019881,"redis_read_bytes":9,"redis_write_bytes":989,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004059,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008491,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.007331,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":7,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.005,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049448,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00072342,"duration_s":0.09322,"completed_at":"2026-08-20T06:00:43.738Z","load_balancing_strategy":"primary","db_duration_s":0.016125,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.164513] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.741Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"6079a6d525515f52e3be4272","created_at":"2026-08-20T06:00:38.770Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.777Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-6079a6d525515f52e3be4272: start","job_status":"start","queue_duration_s":4.963548,"scheduling_latency_s":4.963582} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses, in 0.21 seconds) gitlab # [ 443.188466] gitaly[912]: time="2026-08-20T06:00:43.657Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3V7J56QF527GQ2N02EV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:53.137" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:43.648" grpc.time_ms=9.277 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.208044] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:44 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 522 gitlab # [ 443.211749] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:44 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 175 gitlab # [ 443.215792] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.855Z","retry":25,"queue":"default","version":0,"store":null,"args":["1"],"class":"Ci::TrackFirstPipelineSucceededWorker","jid":"6079a6d525515f52e3be4272","created_at":"2026-08-20T06:00:38.770Z","trace_propagation_headers":{"sentry-trace":"e3878d1a91734be588c14369eed0de70-d4b2f5a1aaea43cf","baggage":"sentry-trace_id=e3878d1a91734be588c14369eed0de70,sentry-release=Unknown"},"correlation_id":"01M0EW119Z9EVDPFSRCYJNSNF5","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c5d2c9faee55896683425d4b50feeb49f6074c2dda34904072dea18e4eda0a9b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:38.777Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackFirstPipelineSucceededWorker JID-6079a6d525515f52e3be4272: done: 0.114489 sec","job_status":"done","queue_duration_s":4.963548,"scheduling_latency_s":4.963582,"redis_calls":14,"redis_duration_s":0.006491,"redis_read_bytes":14,"redis_write_bytes":1335,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000573,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.0038,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002118,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":436,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069049,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00082848,"duration_s":0.114489,"completed_at":"2026-08-20T06:00:43.855Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024946,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.278609] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.858Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"1e63599c44c4c16192e5484f","created_at":"2026-08-20T06:00:39.112Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-a7fa49c9f1e6439e","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:39.122Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-1e63599c44c4c16192e5484f: start","job_status":"start","queue_duration_s":4.735978,"scheduling_latency_s":4.736008} gitlab # [ 443.300982] nixbot[3607]: {"ts": "2026-08-20T06:00:44.026Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/592ba8e1ae809c278127a4883358e06e7303a2a1 \"HTTP/1.1 201 Created\""} gitlab # [ 443.304907] nixbot[3607]: {"ts": "2026-08-20T06:00:44.052Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-592ba8e1ae80-4"} gitlab # [ 443.308562] gitaly[912]: time="2026-08-20T06:00:43.693Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3V7J56QF527GQ2N02EV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-08-20T06:00:53.032" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:43.692" grpc.time_ms=0.448 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.324605] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.993Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"1e63599c44c4c16192e5484f","created_at":"2026-08-20T06:00:39.112Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-a7fa49c9f1e6439e","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:39.122Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-1e63599c44c4c16192e5484f: done: 0.135006 sec","job_status":"done","queue_duration_s":4.735978,"scheduling_latency_s":4.736008,"redis_calls":19,"redis_duration_s":0.03536,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.010642,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.003222,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.015322,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.006174,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.007,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.007,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.073409,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.02949518,"duration_s":0.135006,"completed_at":"2026-08-20T06:00:43.993Z","load_balancing_strategy":"primary","db_duration_s":0.021237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.384663] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:43.996Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","d4ed48ea3bb60c49178268f3"],"class":"WebHooks::LogExecutionWorker","jid":"4372f03643055db35b7d5636","created_at":"2026-08-20T06:00:41.168Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-eb0e33a02caa4162","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7e6c04f50ce06b42cfc0b9309d139a28fabe576b51cb8c9d9817fb840a89fa51","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:41.178Z","job_size_bytes":2593,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-4372f03643055db35b7d5636: start","job_status":"start","queue_duration_s":2.817618,"scheduling_latency_s":2.817661} gitlab # [ 443.409824] nix-daemon[3831]: accepted connection from pid 4468, user nixbot gitlab # [ 443.411224] nix-daemon[3831]: accepted connection from pid 4476, user nixbot gitlab # [ 443.412793] gitaly[912]: time="2026-08-20T06:00:43.721Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=569 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=5 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3V7J56QF527GQ2N02EV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-08-20T06:00:53.041" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:43.702" grpc.time_ms=19.07 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.430224] gitaly[912]: time="2026-08-20T06:00:43.776Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3V7J56QF527GQ2N02EV0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:43.775" grpc.time_ms=1.066 pid=912 span.kind=server system=grpc gitlab # [ 443.444057] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:44.104Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","d4ed48ea3bb60c49178268f3"],"class":"WebHooks::LogExecutionWorker","jid":"4372f03643055db35b7d5636","created_at":"2026-08-20T06:00:41.168Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-eb0e33a02caa4162","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7e6c04f50ce06b42cfc0b9309d139a28fabe576b51cb8c9d9817fb840a89fa51","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:41.178Z","job_size_bytes":2593,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-4372f03643055db35b7d5636: done: 0.108305 sec","job_status":"done","queue_duration_s":2.817618,"scheduling_latency_s":2.817661,"redis_calls":10,"redis_duration_s":0.012805,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004341,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007241,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001223,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.012,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.012,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00051922,"duration_s":0.108305,"completed_at":"2026-08-20T06:00:44.104Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029423,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.505649] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:44.107Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"af40945db0591767f4680994","created_at":"2026-08-20T06:00:42.169Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-aaf7bfa0ef5d4c44","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:42.176Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-af40945db0591767f4680994: start","job_status":"start","queue_duration_s":1.930903,"scheduling_latency_s":1.93094} gitlab # [ 443.529760] nixbot[3607]: {"ts": "2026-08-20T06:00:44.215Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-592ba8e1ae80-4", "argv0": "bwrap"} gitlab # [ 443.533262] gitaly[912]: time="2026-08-20T06:00:43.804Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3V7J56QF527GQ2N02EV0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:43.803" grpc.time_ms=0.759 pid=912 span.kind=server system=grpc gitlab # [ 443.546789] gitaly[912]: time="2026-08-20T06:00:43.815Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3V7J56QF527GQ2N02EV0 diskcache=dac1be93-a136-40b2-92cf-c2dcf3790e0a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:00:53.066" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:43.726" pid=912 ref=refs/keep-around/592ba8e1ae809c278127a4883358e06e7303a2a1 remote_ip="2001:db8:1::1" revision=592ba8e1ae809c278127a4883358e06e7303a2a1 span.kind=server system=grpc username=root gitlab # [ 443.562475] gitaly[912]: time="2026-08-20T06:00:43.816Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=74 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5170 command.oublock=8 command.real_time_ms=82 command.spawn_token_fork_ms=1 command.system_time_ms=48 command.user_time_ms=26 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3V7J56QF527GQ2N02EV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-08-20T06:00:53.066" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-08-20T06:00:43.726" grpc.time_ms=89.783 pid=912 ref=refs/keep-around/592ba8e1ae809c278127a4883358e06e7303a2a1 remote_ip="2001:db8:1::1" revision=592ba8e1ae809c278127a4883358e06e7303a2a1 span.kind=server system=grpc username=root gitlab # [ 443.583351] gitaly[912]: time="2026-08-20T06:00:43.826Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3V7J56QF527GQ2N02EV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:13.820" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:43.821" grpc.time_ms=1.838 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.600704] gitaly[912]: time="2026-08-20T06:00:43.997Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3VKJG8G2PJNX8DP37Y6T grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:13.594" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:43.995" grpc.time_ms=2.163 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.617809] gitaly[912]: time="2026-08-20T06:00:44.284Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3SAG6MN132SCXPRHS3EX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:44.283" grpc.time_ms=0.63 pid=912 span.kind=server system=grpc gitlab # [ 443.629473] gitaly[912]: time="2026-08-20T06:00:44.313Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3SAG6MN132SCXPRHS3EX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3896 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:44.312" grpc.time_ms=0.856 pid=912 span.kind=server system=grpc gitlab # [ 443.642389] gitaly[912]: time="2026-08-20T06:00:44.339Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M0EW3SAG6MN132SCXPRHS3EX grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3898 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-08-20T06:00:44.338" grpc.time_ms=0.695 pid=912 span.kind=server system=grpc gitlab # [ 443.655716] gitaly[912]: time="2026-08-20T06:00:44.358Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3SAG6MN132SCXPRHS3EX diskcache=faf604a2-5ab2-4060-97f1-4c263a6377e4 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:01:14.252" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:44.252" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.669115] gitaly[912]: time="2026-08-20T06:00:44.358Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=92 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7146 command.oublock=0 command.real_time_ms=90 command.spawn_token_fork_ms=1 command.system_time_ms=63 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3SAG6MN132SCXPRHS3EX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-08-20T06:01:14.252" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:44.252" grpc.time_ms=105.481 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.687469] nix-daemon[3831]: accepted connection from pid 4512, user nixbot gitlab # [ 443.689290] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:44.506Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"af40945db0591767f4680994","created_at":"2026-08-20T06:00:42.169Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-aaf7bfa0ef5d4c44","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:42.176Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":3499,"job_status":"rescheduled","message":"PipelineProcessWorker JID-af40945db0591767f4680994: rescheduled"} gitlab # [ 443.708431] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:44.516Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"af40945db0591767f4680994","created_at":"2026-08-20T06:00:42.169Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-aaf7bfa0ef5d4c44","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:42.176Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-af40945db0591767f4680994: done: 0.409248 sec","job_status":"done","queue_duration_s":1.930903,"scheduling_latency_s":1.93094,"gitaly_calls":3,"gitaly_duration_s":0.117772,"redis_calls":66,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.025813000000000003,"redis_read_bytes":151,"redis_write_bytes":18014,"redis_action_cable_calls":2,"redis_action_cable_duration_s":0.000835,"redis_action_cable_read_bytes":2,"redis_action_cable_write_bytes":407,"redis_cache_calls":9,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.001186,"redis_cache_read_bytes":17,"redis_cache_write_bytes":791,"redis_queues_calls":22,"redis_queues_duration_s":0.009022,"redis_queues_read_bytes":29,"redis_queues_write_bytes":12313,"redis_queues_metadata_calls":19,"redis_queues_metadata_duration_s":0.009806,"redis_queues_metadata_read_bytes":30,"redis_queues_metadata_write_bytes":3093,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000468,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.001152,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":8,"redis_shared_state_duration_s":0.002509,"redis_shared_state_read_bytes":13,"redis_shared_state_write_bytes":785,"db_count":30,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.051,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":16,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":2,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.012,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.012,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.028,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.226422,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.33333758,"duration_s":0.409248,"completed_at":"2026-08-20T06:00:44.516Z","load_balancing_strategy":"primary","db_duration_s":0.052881,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 443.780278] gitaly[912]: time="2026-08-20T06:00:44.453Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3SAG6MN132SCXPRHS3EX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:01:14.451" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:44.452" grpc.time_ms=1.194 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.798486] nix-daemon[3831]: accepted connection from pid 4522, user nixbot gitlab # [ 443.799837] nix-daemon[3831]: accepted connection from pid 4512, user nixbot gitlab # [ 443.801275] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:44.518Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e5549f2196d0341203de0ec2"],"class":"WebHooks::LogExecutionWorker","jid":"2480f1c0bf17a747800fb8b0","created_at":"2026-08-20T06:00:42.527Z","trace_propagation_headers":{"sentry-trace":"be5d19a0df32442fa93cf968c0586b74-1a106049a63a40fe","baggage":"sentry-trace_id=be5d19a0df32442fa93cf968c0586b74,sentry-release=Unknown"},"correlation_id":"01M0EW0ZW47E5QZEGR9F67721T","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d88f5850bd8164212d037421781b197ed9906f7866d8468229d39810432c2ee8","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:42.536Z","job_size_bytes":2591,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2480f1c0bf17a747800fb8b0: start","job_status":"start","queue_duration_s":1.982705,"scheduling_latency_s":1.98274} gitlab # [ 443.823326] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:44.557Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","e5549f2196d0341203de0ec2"],"class":"WebHooks::LogExecutionWorker","jid":"2480f1c0bf17a747800fb8b0","created_at":"2026-08-20T06:00:42.527Z","trace_propagation_headers":{"sentry-trace":"be5d19a0df32442fa93cf968c0586b74-1a106049a63a40fe","baggage":"sentry-trace_id=be5d19a0df32442fa93cf968c0586b74,sentry-release=Unknown"},"correlation_id":"01M0EW0ZW47E5QZEGR9F67721T","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d88f5850bd8164212d037421781b197ed9906f7866d8468229d39810432c2ee8","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:42.536Z","job_size_bytes":2591,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-2480f1c0bf17a747800fb8b0: done: 0.038947 sec","job_status":"done","queue_duration_s":1.982705,"scheduling_latency_s":1.98274,"redis_calls":7,"redis_duration_s":0.001927,"redis_read_bytes":5,"redis_write_bytes":671,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001302,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000625,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025419,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038947,"completed_at":"2026-08-20T06:00:44.557Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007134,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 443.882295] gitaly[912]: time="2026-08-20T06:00:44.494Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3SAG6MN132SCXPRHS3EX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:14.493" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:44.493" grpc.time_ms=0.811 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 443.898889] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:44.560Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3f9fd1085a209b5d0f383209","created_at":"2026-08-20T06:00:43.826Z","trace_propagation_headers":{"sentry-trace":"50a04dcdbc184146bc9f92a4d05b329a-d3d9696b8be54a75","baggage":"sentry-trace_id=50a04dcdbc184146bc9f92a4d05b329a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3V7J56QF527GQ2N02EV0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:43.835Z","job_size_bytes":65,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3f9fd1085a209b5d0f383209: start","job_status":"start","queue_duration_s":0.724644,"scheduling_latency_s":0.724675} gitlab # [ 443.920784] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:44.602Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3f9fd1085a209b5d0f383209","created_at":"2026-08-20T06:00:43.826Z","trace_propagation_headers":{"sentry-trace":"50a04dcdbc184146bc9f92a4d05b329a-d3d9696b8be54a75","baggage":"sentry-trace_id=50a04dcdbc184146bc9f92a4d05b329a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3V7J56QF527GQ2N02EV0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:87cea9682199b75c272b7ff1dd93d7c9f14b347650bc2388e7fda305bf1df003","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:43.835Z","job_size_bytes":65,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3f9fd1085a209b5d0f383209: done: 0.042418 sec","job_status":"done","queue_duration_s":0.724644,"scheduling_latency_s":0.724675,"redis_calls":7,"redis_duration_s":0.001881,"redis_read_bytes":5,"redis_write_bytes":731,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001335,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":503,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000546,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":228,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.042418,"completed_at":"2026-08-20T06:00:44.602Z","load_balancing_strategy":"primary","db_duration_s":0.005973,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 443.979559] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:44.604Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d598f9bbfbd01ade080ba0ee","created_at":"2026-08-20T06:00:43.837Z","trace_propagation_headers":{"sentry-trace":"50a04dcdbc184146bc9f92a4d05b329a-d3d9696b8be54a75","baggage":"sentry-trace_id=50a04dcdbc184146bc9f92a4d05b329a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3V7J56QF527GQ2N02EV0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:43.844Z","job_size_bytes":65,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d598f9bbfbd01ade080ba0ee: start","job_status":"start","queue_duration_s":0.759819,"scheduling_latency_s":0.759848} gitlab # [ 444.003627] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:44.722Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e2, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"d598f9bbfbd01ade080ba0ee","created_at":"2026-08-20T06:00:43.837Z","trace_propagation_headers":{"sentry-trace":"50a04dcdbc184146bc9f92a4d05b329a-d3d9696b8be54a75","baggage":"sentry-trace_id=50a04dcdbc184146bc9f92a4d05b329a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3V7J56QF527GQ2N02EV0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fd81ef6159ba89c96a4a693456f0ec7f47423572cce07ee544ec449d0efb8f9c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:43.844Z","job_size_bytes":65,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-d598f9bbfbd01ade080ba0ee: done: 0.118202 sec","job_status":"done","queue_duration_s":0.759819,"scheduling_latency_s":0.759848,"redis_calls":10,"redis_duration_s":0.008879,"redis_read_bytes":14,"redis_write_bytes":857,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001561,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":494,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.007318,"redis_shared_state_read_bytes":10,"redis_shared_state_write_bytes":363,"db_count":11,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":11,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062216,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.118202,"completed_at":"2026-08-20T06:00:44.722Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028323,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 444.060426] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:44.724Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"37c37b9e1a6d8839f14e2698","created_at":"2026-08-20T06:00:43.947Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-08c3dba6a7e747a2","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:43.968Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-37c37b9e1a6d8839f14e2698: start","job_status":"start","queue_duration_s":0.756069,"scheduling_latency_s":0.756104} gitlab # [ 444.083237] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:44.844Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"37c37b9e1a6d8839f14e2698","created_at":"2026-08-20T06:00:43.947Z","trace_propagation_headers":{"sentry-trace":"e22b3ccdfb1d41eb82f45aee8e05f2a6-08c3dba6a7e747a2","baggage":"sentry-trace_id=e22b3ccdfb1d41eb82f45aee8e05f2a6,sentry-release=Unknown"},"correlation_id":"01M0EW0SXJ0D04HH34SAS9F8R6","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:43.968Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-37c37b9e1a6d8839f14e2698: done: 0.119193 sec","job_status":"done","queue_duration_s":0.756069,"scheduling_latency_s":0.756104,"redis_calls":11,"redis_duration_s":0.003192,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000487,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002036,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000669,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.009,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.085338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045828,"duration_s":0.119193,"completed_at":"2026-08-20T06:00:44.843Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029112,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 444.144224] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:44.846Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8e3941d3b1a4437d955f44be","created_at":"2026-08-20T06:00:43.984Z","trace_propagation_headers":{"sentry-trace":"50a04dcdbc184146bc9f92a4d05b329a-d3d9696b8be54a75","baggage":"sentry-trace_id=50a04dcdbc184146bc9f92a4d05b329a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3V7J56QF527GQ2N02EV0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:43.994Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8e3941d3b1a4437d955f44be: start","job_status":"start","queue_duration_s":0.851893,"scheduling_latency_s":0.851921} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses gitlab # [ 444.206279] gitaly[912]: time="2026-08-20T06:00:45.073Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW3V7J56QF527GQ2N02EV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-08-20T06:01:15.070" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:45.071" grpc.time_ms=1.987 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 444.305649] gitaly[912]: time="2026-08-20T06:00:45.173Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3V7J56QF527GQ2N02EV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:15.171" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:45.172" grpc.time_ms=0.897 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 444.346998] gitaly[912]: time="2026-08-20T06:00:45.213Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3WSZAS38F7T3ZPNJDD17 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:15.212" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:45.212" grpc.time_ms=0.87 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses, in 0.21 seconds) gitlab # [ 444.371524] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:45.238Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["2"],"class":"PipelineProcessWorker","jid":"8e3941d3b1a4437d955f44be","created_at":"2026-08-20T06:00:43.984Z","trace_propagation_headers":{"sentry-trace":"50a04dcdbc184146bc9f92a4d05b329a-d3d9696b8be54a75","baggage":"sentry-trace_id=50a04dcdbc184146bc9f92a4d05b329a,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01M0EW3V7J56QF527GQ2N02EV0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:eb86e5e3de0e02766c69db2e2b5051b955094568149296b3fa12a64076975b15","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:43.994Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-8e3941d3b1a4437d955f44be: done: 0.392163 sec","job_status":"done","queue_duration_s":0.851893,"scheduling_latency_s":0.851921,"gitaly_calls":2,"gitaly_duration_s":0.012053,"redis_calls":34,"redis_allowed_cross_slot_calls":1,"redis_duration_s":0.050294,"redis_read_bytes":80,"redis_write_bytes":5122,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.005029,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":10,"redis_cache_allowed_cross_slot_calls":1,"redis_cache_duration_s":0.008577,"redis_cache_read_bytes":19,"redis_cache_write_bytes":892,"redis_queues_calls":2,"redis_queues_duration_s":0.000657,"redis_queues_read_bytes":3,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.01115,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":772,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.001513,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.004688,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.013651,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":551,"db_count":27,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":27,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.134,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":13,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.019,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.025,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.069,"db_ci_duration_s":0.065,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.183844,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.28872266,"duration_s":0.392163,"completed_at":"2026-08-20T06:00:45.238Z","load_balancing_strategy":"primary","db_duration_s":0.155246,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 444.443797] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:45.259Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1a1a10288e88ad1210902ba5","created_at":"2026-08-20T06:00:44.233Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.237Z","job_size_bytes":23,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1a1a10288e88ad1210902ba5: start","job_status":"start","queue_duration_s":1.021911,"scheduling_latency_s":1.02199} gitlab # [ 444.466684] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:45 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 156 gitlab # [ 444.732686] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:45.598Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"1a1a10288e88ad1210902ba5","created_at":"2026-08-20T06:00:44.233Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.237Z","job_size_bytes":23,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-1a1a10288e88ad1210902ba5: done: 0.339172 sec","job_status":"done","queue_duration_s":1.021911,"scheduling_latency_s":1.02199,"redis_calls":7,"redis_duration_s":0.00419,"redis_read_bytes":5,"redis_write_bytes":661,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00277,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":461,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00142,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.239,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.19,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.069417,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.339172,"completed_at":"2026-08-20T06:00:45.598Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.238308,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 444.796395] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:45.609Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5632c390cbbb432afd4cb162","created_at":"2026-08-20T06:00:44.366Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.370Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5632c390cbbb432afd4cb162: start","job_status":"start","queue_duration_s":1.238114,"scheduling_latency_s":1.238158} gitlab # [ 444.866999] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:45.733Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5632c390cbbb432afd4cb162","created_at":"2026-08-20T06:00:44.366Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.370Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5632c390cbbb432afd4cb162: done: 0.12416 sec","job_status":"done","queue_duration_s":1.238114,"scheduling_latency_s":1.238158,"redis_calls":7,"redis_duration_s":0.013054,"redis_read_bytes":5,"redis_write_bytes":746,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008137,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004917,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":234,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.034,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.034,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051678,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.12416,"completed_at":"2026-08-20T06:00:45.733Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.033658,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 444.924258] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:45.739Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"7647ae25e0545a86765bcbbd","created_at":"2026-08-20T06:00:44.382Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.387Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-7647ae25e0545a86765bcbbd: start","job_status":"start","queue_duration_s":1.352037,"scheduling_latency_s":1.352084} gitlab # [ 445.039083] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:45.905Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"7647ae25e0545a86765bcbbd","created_at":"2026-08-20T06:00:44.382Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_quality","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:63f9f7cd25437cd73f59d7b8712965562d29d563b949d0eb0d88506f86c16e46","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.387Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CreateQualityReportWorker JID-7647ae25e0545a86765bcbbd: done: 0.166293 sec","job_status":"done","queue_duration_s":1.352037,"scheduling_latency_s":1.352084,"redis_calls":7,"redis_duration_s":0.018249,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.014088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004161,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.059,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":8,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.059,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.063779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.166293,"completed_at":"2026-08-20T06:00:45.905Z","load_balancing_strategy":"primary","db_duration_s":0.058421,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 445.095693] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:45.921Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9d85ba20857be88c0bf186ec","created_at":"2026-08-20T06:00:44.400Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.407Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9d85ba20857be88c0bf186ec: start","job_status":"start","queue_duration_s":1.513679,"scheduling_latency_s":1.513725} gitlab # [ 445.247379] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:46.111Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::TestFailureHistoryWorker","jid":"9d85ba20857be88c0bf186ec","created_at":"2026-08-20T06:00:44.400Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:d13d7384904dcf1f669f77a046ff89ec7da9f34ad97cdf916c152a957ed611c0","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.407Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TestFailureHistoryWorker JID-9d85ba20857be88c0bf186ec: done: 0.190487 sec","job_status":"done","queue_duration_s":1.513679,"scheduling_latency_s":1.513725,"redis_calls":10,"redis_duration_s":0.019547000000000002,"redis_read_bytes":62,"redis_write_bytes":808,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.008411,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":467,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.005977,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005159,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":204,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.044,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.064969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.190487,"completed_at":"2026-08-20T06:00:46.111Z","load_balancing_strategy":"primary","db_duration_s":0.050494,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 445.307708] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:46.128Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f61aec1d2cdcdd7814238803","created_at":"2026-08-20T06:00:44.408Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.412Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f61aec1d2cdcdd7814238803: start","job_status":"start","queue_duration_s":1.71572,"scheduling_latency_s":1.71577} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses gitlab # [ 445.430961] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:46.297Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CoverageReportWorker","jid":"f61aec1d2cdcdd7814238803","created_at":"2026-08-20T06:00:44.408Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:dec604319992be0929da6e2532a6b9409f09b002c6422a6643ce62aa4e5896b9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.412Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::CoverageReportWorker JID-f61aec1d2cdcdd7814238803: done: 0.169014 sec","job_status":"done","queue_duration_s":1.71572,"scheduling_latency_s":1.71577,"redis_calls":9,"redis_duration_s":0.027362,"redis_read_bytes":167,"redis_write_bytes":834,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.009225,"redis_feature_flag_read_bytes":162,"redis_feature_flag_write_bytes":93,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.014684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003453,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.031,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049651,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.169014,"completed_at":"2026-08-20T06:00:46.296Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030605,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 445.494024] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:46.322Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1a8d7cc2b87b5142519e2554","created_at":"2026-08-20T06:00:44.413Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.417Z","job_size_bytes":19,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1a8d7cc2b87b5142519e2554: start","job_status":"start","queue_duration_s":1.905174,"scheduling_latency_s":1.905223} gitlab # [ 445.552322] gitaly[912]: time="2026-08-20T06:00:46.419Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3XZ68HHERSK391D5M1Y1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:16.017" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:46.418" grpc.time_ms=0.83 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 445.614461] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:46 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 170 gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses, in 0.21 seconds) gitlab # [ 445.627338] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:46.493Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"auto_merge","args":["[FILTERED]"],"class":"AutoMergeProcessWorker","jid":"1a8d7cc2b87b5142519e2554","created_at":"2026-08-20T06:00:44.413Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_delivery","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:92e420870d25c52b5ebdf32286e1720fa4ac32c28b0440972437d5366aa8550b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.417Z","job_size_bytes":19,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"AutoMergeProcessWorker JID-1a8d7cc2b87b5142519e2554: done: 0.17145 sec","job_status":"done","queue_duration_s":1.905174,"scheduling_latency_s":1.905223,"redis_calls":8,"redis_duration_s":0.017535000000000002,"redis_read_bytes":6,"redis_write_bytes":764,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015827,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":570,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001708,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":194,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.03,"db_ci_duration_s":0.013,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.045157,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.17145,"completed_at":"2026-08-20T06:00:46.493Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.042712,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 445.688829] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:46.507Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3129dbccef13641a75157210","created_at":"2026-08-20T06:00:44.418Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.421Z","job_size_bytes":66,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3129dbccef13641a75157210: start","job_status":"start","queue_duration_s":2.085513,"scheduling_latency_s":2.085565} gitlab # [ 445.781170] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:46.647Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineFinishedEvent","{\"pipeline_id\"=\u003e1, \"status\"=\u003e\"success\"}"],"class":"Ci::Workloads::UpdateWorkloadStatusEventWorker","jid":"3129dbccef13641a75157210","created_at":"2026-08-20T06:00:44.418Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f786010d22acb06782f1370d01e07bde28bed0498922adde5f6769effe4cc7f7","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.421Z","job_size_bytes":66,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Workloads::UpdateWorkloadStatusEventWorker JID-3129dbccef13641a75157210: done: 0.139834 sec","job_status":"done","queue_duration_s":2.085513,"scheduling_latency_s":2.085565,"redis_calls":7,"redis_duration_s":0.022487,"redis_read_bytes":5,"redis_write_bytes":761,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011747,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.01074,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":240,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.032,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.032,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046346,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.139834,"completed_at":"2026-08-20T06:00:46.647Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 445.844147] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:46.653Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3027f505c1c14058a5199357","created_at":"2026-08-20T06:00:44.422Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.425Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3027f505c1c14058a5199357: start","job_status":"start","queue_duration_s":2.227548,"scheduling_latency_s":2.227595} gitlab # [ 445.933648] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:46.800Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"Ci::PipelineFinishedWorker","jid":"3027f505c1c14058a5199357","created_at":"2026-08-20T06:00:44.422Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5c8b4490d8f5ea379beda67cd2fb00a658e7ee64e701adca381fbf2e7fc7314f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.425Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineFinishedWorker JID-3027f505c1c14058a5199357: done: 0.147118 sec","job_status":"done","queue_duration_s":2.227548,"scheduling_latency_s":2.227595,"redis_calls":7,"redis_duration_s":0.017492,"redis_read_bytes":5,"redis_write_bytes":656,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010509,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":458,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.006983,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":198,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.147118,"completed_at":"2026-08-20T06:00:46.800Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.02398,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 445.998432] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:46.809Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c2cc19abdce7e99e8dcfa4ba","created_at":"2026-08-20T06:00:44.426Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.429Z","job_size_bytes":6,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c2cc19abdce7e99e8dcfa4ba: start","job_status":"start","queue_duration_s":2.379999,"scheduling_latency_s":2.380066} gitlab # [ 446.029247] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:46.895Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["[FILTERED]"],"class":"Ci::Refs::UnlockPreviousPipelinesWorker","jid":"c2cc19abdce7e99e8dcfa4ba","created_at":"2026-08-20T06:00:44.426Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a0f041753de3870d67154f15c09ece63e0c4ee06ec0f7cfd2b7747953ad06d9d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.429Z","job_size_bytes":6,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Refs::UnlockPreviousPipelinesWorker JID-c2cc19abdce7e99e8dcfa4ba: done: 0.086384 sec","job_status":"done","queue_duration_s":2.379999,"scheduling_latency_s":2.380066,"redis_calls":7,"redis_duration_s":0.014928,"redis_read_bytes":5,"redis_write_bytes":721,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.010878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":497,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00405,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.027,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.086384,"completed_at":"2026-08-20T06:00:46.895Z","load_balancing_strategy":"primary","db_duration_s":0.02656,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 446.087182] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:46.904Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"39592b2ba2bab49f766c6ac5","created_at":"2026-08-20T06:00:44.430Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.433Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-39592b2ba2bab49f766c6ac5: start","job_status":"start","queue_duration_s":2.4704,"scheduling_latency_s":2.470826} gitlab # [ 446.143578] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.010Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1"],"class":"PipelineMetricsWorker","jid":"39592b2ba2bab49f766c6ac5","created_at":"2026-08-20T06:00:44.430Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:644fde72c31829615c47ecd7736206eb57ccdd526788a2927a77070bca65b393","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.433Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineMetricsWorker JID-39592b2ba2bab49f766c6ac5: done: 0.106665 sec","job_status":"done","queue_duration_s":2.4704,"scheduling_latency_s":2.470826,"redis_calls":7,"redis_duration_s":0.013451,"redis_read_bytes":5,"redis_write_bytes":636,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.009186,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":446,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004265,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.011,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.106665,"completed_at":"2026-08-20T06:00:47.010Z","load_balancing_strategy":"primary","db_duration_s":0.021252,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 446.199207] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.022Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"52d2cdc8a1946d98c730c9f3","created_at":"2026-08-20T06:00:44.506Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.509Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-52d2cdc8a1946d98c730c9f3: start","job_status":"start","queue_duration_s":2.512857,"scheduling_latency_s":2.512907} gitlab # [ 446.280832] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.147Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","rescheduled_once":true,"args":["1"],"class":"PipelineProcessWorker","jid":"52d2cdc8a1946d98c730c9f3","created_at":"2026-08-20T06:00:44.506Z","trace_propagation_headers":{"sentry-trace":"b61750d2b66e4420ad1922e91fc8f09c-bc36e21342bc44b0","baggage":"sentry-trace_id=b61750d2b66e4420ad1922e91fc8f09c,sentry-release=Unknown"},"correlation_id":"01M0EW3SAG6MN132SCXPRHS3EX","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.509Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-52d2cdc8a1946d98c730c9f3: done: 0.124774 sec","job_status":"done","queue_duration_s":2.512857,"scheduling_latency_s":2.512907,"redis_calls":8,"redis_duration_s":0.01975,"redis_read_bytes":6,"redis_write_bytes":754,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016557,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":564,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003193,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":190,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044689,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.124774,"completed_at":"2026-08-20T06:00:47.147Z","load_balancing_strategy":"primary","db_duration_s":0.027293,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10} gitlab # [ 446.336106] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.158Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"af5e7040f511b10b59df103a","created_at":"2026-08-20T06:00:44.883Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"573bf32718413e7df19d1b80f6e81410","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.967Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-af5e7040f511b10b59df103a: start","job_status":"start","queue_duration_s":2.191245,"scheduling_latency_s":2.191289} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses gitlab # [ 446.597952] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.464Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"af5e7040f511b10b59df103a","created_at":"2026-08-20T06:00:44.883Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"573bf32718413e7df19d1b80f6e81410","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:44.967Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-af5e7040f511b10b59df103a: done: 0.306174 sec","job_status":"done","queue_duration_s":2.191245,"scheduling_latency_s":2.191289,"redis_calls":65,"redis_duration_s":0.078845,"redis_read_bytes":114,"redis_write_bytes":41282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.010755,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.000857,"redis_queues_read_bytes":3,"redis_queues_write_bytes":36985,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.060445,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.006788,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.198544,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00055524,"duration_s":0.306174,"completed_at":"2026-08-20T06:00:47.464Z","load_balancing_strategy":"primary","db_duration_s":0.007313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 446.654619] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.467Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"8967754f3745f159a251b7be","created_at":"2026-08-20T06:00:45.005Z","trace_propagation_headers":{"sentry-trace":"50a04dcdbc184146bc9f92a4d05b329a-e07e256aba7448da","baggage":"sentry-trace_id=50a04dcdbc184146bc9f92a4d05b329a,sentry-release=Unknown"},"correlation_id":"01M0EW3V7J56QF527GQ2N02EV0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.013Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8967754f3745f159a251b7be: start","job_status":"start","queue_duration_s":2.453448,"scheduling_latency_s":2.453485} gitlab # [ 446.676717] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.540Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["2"],"class":"PipelineHooksWorker","jid":"8967754f3745f159a251b7be","created_at":"2026-08-20T06:00:45.005Z","trace_propagation_headers":{"sentry-trace":"50a04dcdbc184146bc9f92a4d05b329a-e07e256aba7448da","baggage":"sentry-trace_id=50a04dcdbc184146bc9f92a4d05b329a,sentry-release=Unknown"},"correlation_id":"01M0EW3V7J56QF527GQ2N02EV0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4f872504460a03cbbb1f784e98442edd2efbf9bca51705c4112dc946be2ae20e","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.013Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-8967754f3745f159a251b7be: done: 0.073598 sec","job_status":"done","queue_duration_s":2.453448,"scheduling_latency_s":2.453485,"redis_calls":7,"redis_duration_s":0.00565,"redis_read_bytes":5,"redis_write_bytes":626,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00397,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":440,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00168,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":186,"db_count":8,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.073598,"completed_at":"2026-08-20T06:00:47.540Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.015254,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 446.733888] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.543Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4a75d2ceb9ad0d479ddf2d44","created_at":"2026-08-20T06:00:44.999Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7945f5aa0e3b623137f51d3b5b125c6a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.028Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4a75d2ceb9ad0d479ddf2d44: start","job_status":"start","queue_duration_s":2.515052,"scheduling_latency_s":2.515082} gitlab # [ 446.754704] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.563Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses, in 0.14 seconds) gitlab # [ 446.759688] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.573Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"4a75d2ceb9ad0d479ddf2d44","created_at":"2026-08-20T06:00:44.999Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7945f5aa0e3b623137f51d3b5b125c6a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.028Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-4a75d2ceb9ad0d479ddf2d44: done: 0.030234 sec","job_status":"done","queue_duration_s":2.515052,"scheduling_latency_s":2.515082,"redis_calls":9,"redis_duration_s":0.003436,"redis_read_bytes":7,"redis_write_bytes":1185,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00075,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00196,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000726,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016203,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.030234,"completed_at":"2026-08-20T06:00:47.573Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 446.819291] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.576Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"50d8c1d5b708735d8adcfa6f","created_at":"2026-08-20T06:00:45.057Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ee0ced3729d67ceb802aafc5e7e11c0","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.082Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-50d8c1d5b708735d8adcfa6f: start","job_status":"start","queue_duration_s":2.493353,"scheduling_latency_s":2.493387} gitlab # [ 446.840178] gitaly[912]: time="2026-08-20T06:00:47.592Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW3Z54J0832P03EHZEBZT9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:17.590" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:47.591" grpc.time_ms=0.912 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 446.858711] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:47 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 106 gitlab # [ 446.862696] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"50d8c1d5b708735d8adcfa6f","created_at":"2026-08-20T06:00:45.057Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8ee0ced3729d67ceb802aafc5e7e11c0","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.082Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-50d8c1d5b708735d8adcfa6f: done: 0.036708 sec","job_status":"done","queue_duration_s":2.493353,"scheduling_latency_s":2.493387,"redis_calls":10,"redis_duration_s":0.004669,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000721,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00303,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00068682,"duration_s":0.036708,"completed_at":"2026-08-20T06:00:47.612Z","load_balancing_strategy":"primary","db_duration_s":0.000769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 446.919003] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.616Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"84f146a3122d6a8e6929948f","created_at":"2026-08-20T06:00:45.119Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"d7904df532f8eeb7c8e8889a13672d5e","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.156Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-84f146a3122d6a8e6929948f: start","job_status":"start","queue_duration_s":2.460455,"scheduling_latency_s":2.460488} gitlab # [ 446.937872] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.654Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"84f146a3122d6a8e6929948f","created_at":"2026-08-20T06:00:45.119Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"d7904df532f8eeb7c8e8889a13672d5e","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.156Z","job_size_bytes":3,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-84f146a3122d6a8e6929948f: done: 0.037344 sec","job_status":"done","queue_duration_s":2.460455,"scheduling_latency_s":2.460488,"redis_calls":10,"redis_duration_s":0.005037,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001203,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00288,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00067572,"duration_s":0.037344,"completed_at":"2026-08-20T06:00:47.654Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000795,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 446.991916] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.657Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2814877a569b5a56252bffa0","created_at":"2026-08-20T06:00:45.178Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8dd3f167d52261571afe1f5628cc6aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.197Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2814877a569b5a56252bffa0: start","job_status":"start","queue_duration_s":2.45977,"scheduling_latency_s":2.459801} gitlab # [ 447.086908] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.953Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"2814877a569b5a56252bffa0","created_at":"2026-08-20T06:00:45.178Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8dd3f167d52261571afe1f5628cc6aa0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.197Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-2814877a569b5a56252bffa0: done: 0.296712 sec","job_status":"done","queue_duration_s":2.45977,"scheduling_latency_s":2.459801,"redis_calls":13,"redis_duration_s":0.005498,"redis_read_bytes":11,"redis_write_bytes":1567,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00185,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001947,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001701,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":131,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.233377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00099544,"exclusive_lock_hold_duration_s":0.26079322,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.296712,"completed_at":"2026-08-20T06:00:47.953Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.065233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 447.146662] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:47.955Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"cad9ff788586ea79e9443cdb","created_at":"2026-08-20T06:00:45.213Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72ef063132ecf94d301737dd9c524d95","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.241Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-cad9ff788586ea79e9443cdb: start","job_status":"start","queue_duration_s":2.714288,"scheduling_latency_s":2.714316} gitlab # [ 447.167464] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.008Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"cad9ff788586ea79e9443cdb","created_at":"2026-08-20T06:00:45.213Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"72ef063132ecf94d301737dd9c524d95","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.241Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-cad9ff788586ea79e9443cdb: done: 0.052449 sec","job_status":"done","queue_duration_s":2.714288,"scheduling_latency_s":2.714316,"redis_calls":11,"redis_duration_s":0.003783,"redis_read_bytes":9,"redis_write_bytes":1518,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000692,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001603,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001488,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028062,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0008538,"exclusive_lock_hold_duration_s":0.01649532,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.052449,"completed_at":"2026-08-20T06:00:48.008Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.016223,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 447.227663] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.010Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::ManageEvidenceWorker","jid":"95117a01e69f85b6aafc43c7","created_at":"2026-08-20T06:00:45.246Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6451bfb2790951304ca84a21ca00c37a","meta.root_caller_id":"Cronjob","meta.feature_category":"release_evidence","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca33015ef91ab20408351751cf9ad5e1289a7d78257a0117231d08455e951d7f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.258Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::ManageEvidenceWorker JID-95117a01e69f85b6aafc43c7: start","job_status":"start","queue_duration_s":2.752484,"scheduling_latency_s":2.752517} gitlab # [ 447.247161] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.064Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Releases::ManageEvidenceWorker","jid":"95117a01e69f85b6aafc43c7","created_at":"2026-08-20T06:00:45.246Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6451bfb2790951304ca84a21ca00c37a","meta.root_caller_id":"Cronjob","meta.feature_category":"release_evidence","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ca33015ef91ab20408351751cf9ad5e1289a7d78257a0117231d08455e951d7f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.258Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Releases::ManageEvidenceWorker JID-95117a01e69f85b6aafc43c7: done: 0.053992 sec","job_status":"done","queue_duration_s":2.752484,"scheduling_latency_s":2.752517,"redis_calls":10,"redis_duration_s":0.003156,"redis_read_bytes":9,"redis_write_bytes":1055,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000482,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001953,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000721,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":206,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031473,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00071158,"duration_s":0.053992,"completed_at":"2026-08-20T06:00:48.064Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013724,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 447.304446] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.067Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"2c700bbbeed80812c4214cc2","created_at":"2026-08-20T06:00:45.284Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cf315a79f473baf3e85277ef56b3f17","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.305Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-2c700bbbeed80812c4214cc2: start","job_status":"start","queue_duration_s":2.762284,"scheduling_latency_s":2.762324} gitlab # [ 447.322791] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckMergeJobsWorker","jid":"2c700bbbeed80812c4214cc2","created_at":"2026-08-20T06:00:45.284Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1cf315a79f473baf3e85277ef56b3f17","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:ce304458c2d63d5d84855b65f51692704db52bf763a718b10c08a2bd5f588f06","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.305Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckMergeJobsWorker JID-2c700bbbeed80812c4214cc2: done: 0.035322 sec","job_status":"done","queue_duration_s":2.762284,"scheduling_latency_s":2.762324,"redis_calls":11,"redis_duration_s":0.005534,"redis_read_bytes":10,"redis_write_bytes":1022,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000953,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002977,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001604,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":225,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021792,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00072424,"duration_s":0.035322,"completed_at":"2026-08-20T06:00:48.102Z","load_balancing_strategy":"primary","db_duration_s":0.00099,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 447.375863] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.106Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"1665a7babf71203044cc297d","created_at":"2026-08-20T06:00:45.487Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f01a86122b65288be0320ca7cf1eb54a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.518Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-1665a7babf71203044cc297d: start","job_status":"start","queue_duration_s":2.587963,"scheduling_latency_s":2.587998} gitlab # [ 447.395251] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.154Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"1665a7babf71203044cc297d","created_at":"2026-08-20T06:00:45.487Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f01a86122b65288be0320ca7cf1eb54a","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.518Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-1665a7babf71203044cc297d: done: 0.047923 sec","job_status":"done","queue_duration_s":2.587963,"scheduling_latency_s":2.587998,"redis_calls":9,"redis_duration_s":0.004518,"redis_read_bytes":7,"redis_write_bytes":1026,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0007,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":315,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002382,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001436,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.047923,"completed_at":"2026-08-20T06:00:48.153Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006377,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 447.451729] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.157Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryArchiveCacheWorker","jid":"1a6f0eef9a0a7432cd987241","created_at":"2026-08-20T06:00:45.538Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14a0f152d66234791dbe7a484aa21d41","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:e95d964ef170969342a5c9d45a52aad8532569d2d839f18acfd130ccc124369d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.572Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryArchiveCacheWorker JID-1a6f0eef9a0a7432cd987241: start","job_status":"start","queue_duration_s":2.585667,"scheduling_latency_s":2.58571} gitlab # [ 447.469713] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.208Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"RepositoryArchiveCacheWorker","jid":"1a6f0eef9a0a7432cd987241","created_at":"2026-08-20T06:00:45.538Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14a0f152d66234791dbe7a484aa21d41","meta.root_caller_id":"Cronjob","meta.feature_category":"source_code_management","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:e95d964ef170969342a5c9d45a52aad8532569d2d839f18acfd130ccc124369d","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.572Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"RepositoryArchiveCacheWorker JID-1a6f0eef9a0a7432cd987241: done: 0.050435 sec","job_status":"done","queue_duration_s":2.585667,"scheduling_latency_s":2.58571,"redis_calls":12,"redis_duration_s":0.0069110000000000005,"redis_read_bytes":11,"redis_write_bytes":1392,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.002441,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":640,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003264,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001206,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":206,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00103454,"duration_s":0.050435,"completed_at":"2026-08-20T06:00:48.208Z","load_balancing_strategy":"primary","db_duration_s":0.002216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 447.526978] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.211Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"d8ed901aba64cd7b361dd598","created_at":"2026-08-20T06:00:45.592Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b73dedcc3907727df64ecb63356b64d","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.614Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-d8ed901aba64cd7b361dd598: start","job_status":"start","queue_duration_s":2.597249,"scheduling_latency_s":2.597495} gitlab # [ 447.545092] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Issues::RescheduleStuckIssueRebalancesWorker","jid":"d8ed901aba64cd7b361dd598","created_at":"2026-08-20T06:00:45.592Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8b73dedcc3907727df64ecb63356b64d","meta.root_caller_id":"Cronjob","meta.feature_category":"team_planning","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fc2fa70b35c572764e1a8fbcbc4fdd3df48ec5a5855870d65915560d23915134","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.614Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Issues::RescheduleStuckIssueRebalancesWorker JID-d8ed901aba64cd7b361dd598: done: 0.039556 sec","job_status":"done","queue_duration_s":2.597249,"scheduling_latency_s":2.597495,"redis_calls":11,"redis_duration_s":0.005765,"redis_read_bytes":9,"redis_write_bytes":1239,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001198,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002898,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":298,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00060586,"duration_s":0.039556,"completed_at":"2026-08-20T06:00:48.251Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001243,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 447.604173] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.253Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c29ca3acc7897b1f13083f20","created_at":"2026-08-20T06:00:45.640Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62a599bc30c57ac15bb9708c995ee6d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.669Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c29ca3acc7897b1f13083f20: start","job_status":"start","queue_duration_s":2.584204,"scheduling_latency_s":2.584228} gitlab # [ 447.625213] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.270Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0} gitlab # [ 447.630835] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c29ca3acc7897b1f13083f20","created_at":"2026-08-20T06:00:45.640Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"62a599bc30c57ac15bb9708c995ee6d1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.669Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c29ca3acc7897b1f13083f20: done: 0.026119 sec","job_status":"done","queue_duration_s":2.584204,"scheduling_latency_s":2.584228,"redis_calls":9,"redis_duration_s":0.003189,"redis_read_bytes":7,"redis_write_bytes":1178,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000698,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001797,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000694,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026119,"completed_at":"2026-08-20T06:00:48.279Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00078,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 447.687316] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.281Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"8a17f534f2c21e1e28ff0d71","created_at":"2026-08-20T06:00:45.679Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc65b01f5c8017fea602c3f103a63470","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.721Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-8a17f534f2c21e1e28ff0d71: start","job_status":"start","queue_duration_s":2.560549,"scheduling_latency_s":2.560576} gitlab # [ 447.706827] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"8a17f534f2c21e1e28ff0d71","created_at":"2026-08-20T06:00:45.679Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc65b01f5c8017fea602c3f103a63470","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.721Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-8a17f534f2c21e1e28ff0d71: done: 0.032743 sec","job_status":"done","queue_duration_s":2.560549,"scheduling_latency_s":2.560576,"redis_calls":10,"redis_duration_s":0.004693,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00122,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002406,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001067,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0006097,"duration_s":0.032743,"completed_at":"2026-08-20T06:00:48.314Z","load_balancing_strategy":"primary","db_duration_s":0.000877,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses gitlab # [ 447.759749] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.317Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"54422647bc939396c50049a5","created_at":"2026-08-20T06:00:45.744Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"470ba415f5d70f1504316773f6d0a3da","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.770Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-54422647bc939396c50049a5: start","job_status":"start","queue_duration_s":2.546712,"scheduling_latency_s":2.546739} gitlab # [ 447.776291] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.387Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"54422647bc939396c50049a5","created_at":"2026-08-20T06:00:45.744Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"470ba415f5d70f1504316773f6d0a3da","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.770Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-54422647bc939396c50049a5: done: 0.070123 sec","job_status":"done","queue_duration_s":2.546712,"scheduling_latency_s":2.546739,"redis_calls":10,"redis_duration_s":0.004994,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002927,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001063,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037903,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00084294,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.00769684},"duration_s":0.070123,"completed_at":"2026-08-20T06:00:48.387Z","load_balancing_strategy":"primary","db_duration_s":0.019844,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 447.833947] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.390Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"dcb725609053d8ba3b27e557","created_at":"2026-08-20T06:00:45.795Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"317020880d6cea2fcdf1119cfa23fe8f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.820Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-dcb725609053d8ba3b27e557: start","job_status":"start","queue_duration_s":2.569867,"scheduling_latency_s":2.569902} gitlab # [ 447.851642] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.441Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"dcb725609053d8ba3b27e557","created_at":"2026-08-20T06:00:45.795Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"317020880d6cea2fcdf1119cfa23fe8f","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.820Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-dcb725609053d8ba3b27e557: done: 0.050542 sec","job_status":"done","queue_duration_s":2.569867,"scheduling_latency_s":2.569902,"redis_calls":11,"redis_duration_s":0.014972,"redis_read_bytes":8,"redis_write_bytes":1094,"redis_cache_calls":2,"redis_cache_duration_s":0.009778,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001187,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002748,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":482,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001259,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.050542,"completed_at":"2026-08-20T06:00:48.441Z","load_balancing_strategy":"primary","db_duration_s":0.001148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 447.911085] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.444Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"07297707ee2bacfcf3af7743","created_at":"2026-08-20T06:00:45.844Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2608a61490541bdf3ecc58cebc637ec","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.882Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-07297707ee2bacfcf3af7743: start","job_status":"start","queue_duration_s":2.56218,"scheduling_latency_s":2.562226} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses, in 0.19 seconds) gitlab # [ 447.928306] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.507Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"07297707ee2bacfcf3af7743","created_at":"2026-08-20T06:00:45.844Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d2608a61490541bdf3ecc58cebc637ec","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.882Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-07297707ee2bacfcf3af7743: done: 0.062778 sec","job_status":"done","queue_duration_s":2.56218,"scheduling_latency_s":2.562226,"redis_calls":11,"redis_duration_s":0.006070000000000001,"redis_read_bytes":9,"redis_write_bytes":1399,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000882,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002462,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002726,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00214926,"exclusive_lock_hold_duration_s":0.01321358,"duration_s":0.062778,"completed_at":"2026-08-20T06:00:48.507Z","load_balancing_strategy":"primary","db_duration_s":0.005701,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 447.987475] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.511Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["[FILTERED]"],"class":"Database::BackgroundOperation::CronEnqueueWorker","jid":"ff2f4a18a6a3a688dddca171","created_at":"2026-08-20T06:00:45.899Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc9c892013c891e90fa99a48d987e85b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:38f97efb1ac6a87ded5913833f7d951478e91a6be2a4328abbe154ee188cf7fb","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.920Z","job_size_bytes":101,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CronEnqueueWorker JID-ff2f4a18a6a3a688dddca171: start","job_status":"start","queue_duration_s":2.590644,"scheduling_latency_s":2.590685} gitlab # [ 448.008134] gitaly[912]: time="2026-08-20T06:00:48.773Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW4096QHM67Q8NRAQK403M grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:18.371" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:48.771" grpc.time_ms=0.698 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 448.028379] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:48 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses HTTP/1.1" 200 633 "" "curl/8.21.0" 141 gitlab # [ 448.032361] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.597Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["[FILTERED]"],"class":"Database::BackgroundOperation::CronEnqueueWorker","jid":"ff2f4a18a6a3a688dddca171","created_at":"2026-08-20T06:00:45.899Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fc9c892013c891e90fa99a48d987e85b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:38f97efb1ac6a87ded5913833f7d951478e91a6be2a4328abbe154ee188cf7fb","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.920Z","job_size_bytes":101,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CronEnqueueWorker JID-ff2f4a18a6a3a688dddca171: done: 0.086203 sec","job_status":"done","queue_duration_s":2.590644,"scheduling_latency_s":2.590685,"redis_calls":10,"redis_duration_s":0.0038079999999999998,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000862,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002231,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000715,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":6,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.058852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00070942,"duration_s":0.086203,"completed_at":"2026-08-20T06:00:48.597Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.018356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 448.091906] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"5454160386f2f55c46bef255","created_at":"2026-08-20T06:00:45.931Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd8be3b418118867e5e120fa9d13cefc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.945Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-5454160386f2f55c46bef255: start","job_status":"start","queue_duration_s":2.65403,"scheduling_latency_s":2.654062} gitlab # [ 448.112198] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.633Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::PipelineArtifacts::ExpireArtifactsWorker","jid":"5454160386f2f55c46bef255","created_at":"2026-08-20T06:00:45.931Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd8be3b418118867e5e120fa9d13cefc","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:35dc78c13bdf78a98c09fc2795030a4961be87ad882288b77a6a3c9be677e4d5","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:45.945Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::PipelineArtifacts::ExpireArtifactsWorker JID-5454160386f2f55c46bef255: done: 0.034115 sec","job_status":"done","queue_duration_s":2.65403,"scheduling_latency_s":2.654062,"redis_calls":12,"redis_duration_s":0.003133,"redis_read_bytes":11,"redis_write_bytes":1481,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000473,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001436,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001224,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":548,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020496,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00069428,"exclusive_lock_hold_duration_s":0.01037032,"extra.ci_pipeline_artifacts_expire_artifacts_worker.destroyed_pipeline_artifacts_count":0,"duration_s":0.034115,"completed_at":"2026-08-20T06:00:48.633Z","load_balancing_strategy":"primary","db_duration_s":0.004583,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 448.169439] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.635Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ImportExportProjectCleanupWorker","jid":"bb783f1246ccefe5dee4be55","created_at":"2026-08-20T06:00:45.971Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bcbee6514bb9258d923147c06688685","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c1ab68355154ed2a8f72791841b7337bdce81d68788119e527d7446bb987ef9a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.005Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"ImportExportProjectCleanupWorker JID-bb783f1246ccefe5dee4be55: start","job_status":"start","queue_duration_s":2.629669,"scheduling_latency_s":2.629691} gitlab # [ 448.187319] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.823Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ImportExportProjectCleanupWorker","jid":"bb783f1246ccefe5dee4be55","created_at":"2026-08-20T06:00:45.971Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3bcbee6514bb9258d923147c06688685","meta.root_caller_id":"Cronjob","meta.feature_category":"importers","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:c1ab68355154ed2a8f72791841b7337bdce81d68788119e527d7446bb987ef9a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.005Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"ImportExportProjectCleanupWorker JID-bb783f1246ccefe5dee4be55: done: 0.188082 sec","job_status":"done","queue_duration_s":2.629669,"scheduling_latency_s":2.629691,"redis_calls":12,"redis_duration_s":0.002928,"redis_read_bytes":11,"redis_write_bytes":1420,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001202,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":638,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001265,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000461,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.166066,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033308,"duration_s":0.188082,"completed_at":"2026-08-20T06:00:48.823Z","load_balancing_strategy":"primary","db_duration_s":0.005586,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 448.241401] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a9167f1376dac8cf35ba749d","created_at":"2026-08-20T06:00:46.025Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53361c0cd32932ba2644eac30ffcd5b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.035Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a9167f1376dac8cf35ba749d: start","job_status":"start","queue_duration_s":2.789436,"scheduling_latency_s":2.789469} gitlab # [ 448.262165] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a9167f1376dac8cf35ba749d","created_at":"2026-08-20T06:00:46.025Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"53361c0cd32932ba2644eac30ffcd5b0","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.035Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a9167f1376dac8cf35ba749d: done: 0.03895 sec","job_status":"done","queue_duration_s":2.789436,"scheduling_latency_s":2.789469,"redis_calls":11,"redis_duration_s":0.008368,"redis_read_bytes":9,"redis_write_bytes":1459,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001191,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004229,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002948,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020396,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03895,"completed_at":"2026-08-20T06:00:48.863Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001456,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 448.320740] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.866Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PruneOldEventsWorker","jid":"86504bcc860fe5734c1885e8","created_at":"2026-08-20T06:00:46.049Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0dc32033083853d7fd69f897ab8f8e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aa7847a0e96d8dccea25d7c51fc9fba0c73a3fc691400b9310229c28e3c4fab3","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.079Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PruneOldEventsWorker JID-86504bcc860fe5734c1885e8: start","job_status":"start","queue_duration_s":2.786968,"scheduling_latency_s":2.787006} gitlab # [ 448.338850] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.908Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PruneOldEventsWorker","jid":"86504bcc860fe5734c1885e8","created_at":"2026-08-20T06:00:46.049Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0dc32033083853d7fd69f897ab8f8e9a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:aa7847a0e96d8dccea25d7c51fc9fba0c73a3fc691400b9310229c28e3c4fab3","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.079Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"PruneOldEventsWorker JID-86504bcc860fe5734c1885e8: done: 0.04182 sec","job_status":"done","queue_duration_s":2.786968,"scheduling_latency_s":2.787006,"redis_calls":10,"redis_duration_s":0.004136,"redis_read_bytes":9,"redis_write_bytes":987,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000784,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":283,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002598,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":514,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000754,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":190,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00094698,"duration_s":0.04182,"completed_at":"2026-08-20T06:00:48.908Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003316,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 448.395847] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.910Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"8d2d245fd2129a9f49b84ff7","created_at":"2026-08-20T06:00:46.100Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2879d05df7e6d23eae47c140210cd12","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.124Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-8d2d245fd2129a9f49b84ff7: start","job_status":"start","queue_duration_s":2.786344,"scheduling_latency_s":2.78638} gitlab # [ 448.415181] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.957Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"8d2d245fd2129a9f49b84ff7","created_at":"2026-08-20T06:00:46.100Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2879d05df7e6d23eae47c140210cd12","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.124Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-8d2d245fd2129a9f49b84ff7: done: 0.046763 sec","job_status":"done","queue_duration_s":2.786344,"scheduling_latency_s":2.78638,"redis_calls":20,"redis_duration_s":0.005699,"redis_read_bytes":23,"redis_write_bytes":4315,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001542,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000774,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2020,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002808,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000575,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037134,"duration_s":0.046763,"completed_at":"2026-08-20T06:00:48.957Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001869,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 448.473029] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.959Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"af4bd966fe60d72be43b1714","created_at":"2026-08-20T06:00:46.138Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"711ec92fee7b469c975f09864f529dca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.160Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-af4bd966fe60d72be43b1714: start","job_status":"start","queue_duration_s":2.79854,"scheduling_latency_s":2.798571} gitlab # [ 448.493414] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.974Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0} gitlab # [ 448.498201] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.983Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"af4bd966fe60d72be43b1714","created_at":"2026-08-20T06:00:46.138Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"711ec92fee7b469c975f09864f529dca","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.160Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-af4bd966fe60d72be43b1714: done: 0.024804 sec","job_status":"done","queue_duration_s":2.79854,"scheduling_latency_s":2.798571,"redis_calls":9,"redis_duration_s":0.0021780000000000002,"redis_read_bytes":7,"redis_write_bytes":1112,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000532,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001132,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000514,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015607,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024804,"completed_at":"2026-08-20T06:00:48.983Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00062,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 448.559193] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:48.987Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9c96957a845ebab9a50f5c14","created_at":"2026-08-20T06:00:46.192Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef506a6d2b019629ee4417677d8a9583","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:00:46.218Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9c96957a845ebab9a50f5c14: start","job_status":"start","queue_duration_s":2.769032,"scheduling_latency_s":2.769065} gitlab # [ 448.577553] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.035Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"9c96957a845ebab9a50f5c14","created_at":"2026-08-20T06:00:46.192Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ef506a6d2b019629ee4417677d8a9583","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-08-20T06:00:46.218Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-9c96957a845ebab9a50f5c14: done: 0.048498 sec","job_status":"done","queue_duration_s":2.769032,"scheduling_latency_s":2.769065,"redis_calls":9,"redis_duration_s":0.002718,"redis_read_bytes":7,"redis_write_bytes":1068,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00067,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001406,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000642,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048498,"completed_at":"2026-08-20T06:00:49.035Z","load_balancing_strategy":"primary","db_duration_s":0.006508,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 448.633106] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.038Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"5e53a5db966d57a97c6a655a","created_at":"2026-08-20T06:00:46.238Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ca1512a78eec7b1b13bb710fb6b5616","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.259Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-5e53a5db966d57a97c6a655a: start","job_status":"start","queue_duration_s":2.779261,"scheduling_latency_s":2.7793} gitlab # [ 448.652416] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.085Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"5e53a5db966d57a97c6a655a","created_at":"2026-08-20T06:00:46.238Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0ca1512a78eec7b1b13bb710fb6b5616","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.259Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-5e53a5db966d57a97c6a655a: done: 0.047386 sec","job_status":"done","queue_duration_s":2.779261,"scheduling_latency_s":2.7793,"redis_calls":13,"redis_duration_s":0.004709,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000554,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002213,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.001942,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00102394,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.047386,"completed_at":"2026-08-20T06:00:49.085Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009352,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 448.715314] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.089Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"b1b01e638d1e13851c9ceee3","created_at":"2026-08-20T06:00:46.282Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d8763e037a2d96d5ef6fdc52264443f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.313Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-b1b01e638d1e13851c9ceee3: start","job_status":"start","queue_duration_s":2.776114,"scheduling_latency_s":2.776147} gitlab # [ 448.733387] gitaly[912]: time="2026-08-20T06:00:49.479Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW40YNZ718JCY974Q1533C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:19.478" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:49.478" grpc.time_ms=0.898 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 448.750588] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.152Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleBulkDeleteJobArtifactCronWorker","jid":"b1b01e638d1e13851c9ceee3","created_at":"2026-08-20T06:00:46.282Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0d8763e037a2d96d5ef6fdc52264443f","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6fd978bae1387dafc89025ea66dbcf41624e32b5e06562317011e023b1327155","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.313Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleBulkDeleteJobArtifactCronWorker JID-b1b01e638d1e13851c9ceee3: done: 0.062949 sec","job_status":"done","queue_duration_s":2.776114,"scheduling_latency_s":2.776147,"redis_calls":24,"redis_duration_s":0.007556,"redis_read_bytes":25,"redis_write_bytes":5972,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001261,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":704,"redis_queues_calls":2,"redis_queues_duration_s":0.000469,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3805,"redis_queues_metadata_calls":11,"redis_queues_metadata_duration_s":0.003452,"redis_queues_metadata_read_bytes":14,"redis_queues_metadata_write_bytes":894,"redis_shared_state_calls":7,"redis_shared_state_duration_s":0.002374,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":569,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.044872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00052458,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.max_buckets":5,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.available_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.occupied_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.stale_count":0,"extra.ci_schedule_bulk_delete_job_artifact_cron_worker.missing_count":5,"duration_s":0.062949,"completed_at":"2026-08-20T06:00:49.152Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001779,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 448.812150] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.155Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2bf36869a36d0d94ce65c701","created_at":"2026-08-20T06:00:46.335Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb17be3cc1f9d0df88d3d3c76869d098","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.390Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2bf36869a36d0d94ce65c701: start","job_status":"start","queue_duration_s":2.764275,"scheduling_latency_s":2.764313} gitlab # [ 448.830959] gitaly[912]: time="2026-08-20T06:00:49.561Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW40YNZ718JCY974Q1533C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:59.040" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:49.550" grpc.time_ms=11.223 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 448.847172] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 281 gitlab # [ 448.851479] nixbot[3607]: {"ts": "2026-08-20T06:00:49.648Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/592ba8e1ae809c278127a4883358e06e7303a2a1 \"HTTP/1.1 201 Created\""} gitlab # [ 448.856303] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"2bf36869a36d0d94ce65c701","created_at":"2026-08-20T06:00:46.335Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cb17be3cc1f9d0df88d3d3c76869d098","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.390Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-2bf36869a36d0d94ce65c701: done: 0.049745 sec","job_status":"done","queue_duration_s":2.764275,"scheduling_latency_s":2.764313,"redis_calls":11,"redis_duration_s":0.005524,"redis_read_bytes":9,"redis_write_bytes":1418,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0009,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002367,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002257,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031282,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00126212,"exclusive_lock_hold_duration_s":0.00539416,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.049745,"completed_at":"2026-08-20T06:00:49.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002872,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 448.913910] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.207Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f8b41469be30e87130021354","created_at":"2026-08-20T06:00:46.433Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d157312a030fcda8231d1df54440b76","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T06:00:46.451Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f8b41469be30e87130021354: start","job_status":"start","queue_duration_s":2.755754,"scheduling_latency_s":2.75579} gitlab # [ 448.931915] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.227Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses gitlab # [ 448.937674] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"f8b41469be30e87130021354","created_at":"2026-08-20T06:00:46.433Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d157312a030fcda8231d1df54440b76","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-08-20T06:00:46.451Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-f8b41469be30e87130021354: done: 0.03194 sec","job_status":"done","queue_duration_s":2.755754,"scheduling_latency_s":2.75579,"redis_calls":9,"redis_duration_s":0.00283,"redis_read_bytes":7,"redis_write_bytes":1152,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000654,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001528,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000648,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019625,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03194,"completed_at":"2026-08-20T06:00:49.239Z","load_balancing_strategy":"primary","db_duration_s":0.000839,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 448.988841] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"effaa6165294beba75f71f37","created_at":"2026-08-20T06:00:46.474Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"030a9e70b741d83fc121413db2c19fa1","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.500Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-effaa6165294beba75f71f37: start","job_status":"start","queue_duration_s":2.740881,"scheduling_latency_s":2.740908} gitlab # [ 449.006246] gitaly[912]: time="2026-08-20T06:00:49.750Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW417WJMA8AY0F4KE3TMH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:19.748" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:49.749" grpc.time_ms=0.845 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.023775] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.278Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"effaa6165294beba75f71f37","created_at":"2026-08-20T06:00:46.474Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"030a9e70b741d83fc121413db2c19fa1","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.500Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-effaa6165294beba75f71f37: done: 0.037076 sec","job_status":"done","queue_duration_s":2.740881,"scheduling_latency_s":2.740908,"redis_calls":9,"redis_duration_s":0.002469,"redis_read_bytes":7,"redis_write_bytes":1127,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000483,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001365,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":536,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000621,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.037076,"completed_at":"2026-08-20T06:00:49.277Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004296,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 449.082756] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"be5b1197de016db930f49e7c","created_at":"2026-08-20T06:00:46.512Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c59593dbed945285c8df290b6a20294","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.535Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-be5b1197de016db930f49e7c: start","job_status":"start","queue_duration_s":2.743843,"scheduling_latency_s":2.743873} gitlab # [ 449.104063] gitaly[912]: time="2026-08-20T06:00:49.821Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW417WJMA8AY0F4KE3TMH6 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:00:59.151" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:49.811" grpc.time_ms=9.205 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.124234] nixbot[3607]: {"ts": "2026-08-20T06:00:49.937Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/592ba8e1ae809c278127a4883358e06e7303a2a1 \"HTTP/1.1 201 Created\""} gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses, in 0.17 seconds) gitlab # [ 449.127908] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"be5b1197de016db930f49e7c","created_at":"2026-08-20T06:00:46.512Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c59593dbed945285c8df290b6a20294","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.535Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-be5b1197de016db930f49e7c: done: 0.035503 sec","job_status":"done","queue_duration_s":2.743843,"scheduling_latency_s":2.743873,"redis_calls":9,"redis_duration_s":0.005748,"redis_read_bytes":7,"redis_write_bytes":1119,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002444,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002332,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000972,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019555,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.035503,"completed_at":"2026-08-20T06:00:49.315Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0008,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 449.185249] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.318Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"9de3615c47c33b637b0f7250","created_at":"2026-08-20T06:00:46.564Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3d9cc925943c510fe905ed8c06787d1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.594Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-9de3615c47c33b637b0f7250: start","job_status":"start","queue_duration_s":2.723234,"scheduling_latency_s":2.723271} gitlab # [ 449.206246] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:49 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 275 gitlab # [ 449.209974] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:49 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses HTTP/1.1" 200 1307 "" "curl/8.21.0" 123 gitlab # [ 449.213841] gitaly[912]: time="2026-08-20T06:00:49.941Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW41ED379087JFTDNZJWH4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:19.540" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:49.940" grpc.time_ms=0.731 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.231945] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.359Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ObjectStorage::DeleteStaleDirectUploadsWorker","jid":"9de3615c47c33b637b0f7250","created_at":"2026-08-20T06:00:46.564Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3d9cc925943c510fe905ed8c06787d1","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:da92be7816ff691bea6b0627c50cb73b98e4b5009a988cab37d277c0df9aa326","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.594Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"ObjectStorage::DeleteStaleDirectUploadsWorker JID-9de3615c47c33b637b0f7250: done: 0.041225 sec","job_status":"done","queue_duration_s":2.723234,"scheduling_latency_s":2.723271,"redis_calls":12,"redis_duration_s":0.0057350000000000005,"redis_read_bytes":11,"redis_write_bytes":1247,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000756,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00289,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002089,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":296,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025628,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00075778,"extra.object_storage_delete_stale_direct_uploads_worker.total_pending_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.total_deleted_stale_entries":0,"extra.object_storage_delete_stale_direct_uploads_worker.execution_timeout":false,"duration_s":0.041225,"completed_at":"2026-08-20T06:00:49.359Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000734,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 449.295318] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:49.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"2fc37d730b63e02c278d47c9","created_at":"2026-08-20T06:00:46.623Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f14f83c984c650d260c234b1efcfbbd","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.644Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-2fc37d730b63e02c278d47c9: start","job_status":"start","queue_duration_s":2.717899,"scheduling_latency_s":2.717937} gitlab # [ 449.314737] gitaly[912]: time="2026-08-20T06:00:50.039Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW41H0H5H402JKQAQB2FGQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-08-20T06:01:20.036" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-08-20T06:00:50.037" grpc.time_ms=1.025 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.332945] nixbot[3607]: {"ts": "2026-08-20T06:00:50.168Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/592ba8e1ae809c278127a4883358e06e7303a2a1 \"HTTP/1.1 201 Created\""} gitlab # [ 449.337994] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/592ba8e1ae809c278127a4883358e06e7303a2a1 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 214 gitlab # [ 449.341688] gitaly[912]: time="2026-08-20T06:00:50.097Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M0EW41H0H5H402JKQAQB2FGQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-08-20T06:01:00.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-08-20T06:00:50.087" grpc.time_ms=9.594 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root gitlab # [ 449.396806] nix-daemon[3831]: accepted connection from pid 4580, user nixbot gitlab # [ 449.529531] gitaly[912]: time="2026-08-20T06:00:50.396Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M0EW41W9FWGNKJH4Z7HHCQY4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=190 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:50.386" grpc.time_ms=10.36 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 449.551464] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:50 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 83 gitlab # [ 449.639185] gitaly[912]: time="2026-08-20T06:00:50.506Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M0EW41YZM73D886BS78QBSGS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:50.496" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc gitlab # [ 449.652197] gitaly[912]: time="2026-08-20T06:00:50.506Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW41YZM73D886BS78QBSGS grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:50.496" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 449.671952] gitlab-workhorse[819]: time="2026-08-20T06:00:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=67 gitlab # [ 449.674989] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:50 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 108 gitlab # [ 449.677911] gitaly[912]: time="2026-08-20T06:00:50.507Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M0EW41YZM73D886BS78QBSGS grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-08-20T06:00:50.496" grpc.time_ms=11.083 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc gitlab # [ 449.750000] nix-daemon[3831]: accepted connection from pid 4605, user nixbot gitlab # [ 449.843932] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:50.710Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"2fc37d730b63e02c278d47c9","created_at":"2026-08-20T06:00:46.623Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5f14f83c984c650d260c234b1efcfbbd","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.644Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-2fc37d730b63e02c278d47c9: done: 1.348362 sec","job_status":"done","queue_duration_s":2.717899,"scheduling_latency_s":2.717937,"redis_calls":564,"redis_duration_s":0.8018879999999999,"redis_read_bytes":562,"redis_write_bytes":49063,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004927,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.794677,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.595857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.348362,"completed_at":"2026-08-20T06:00:50.710Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001093,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 449.900728] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:50.721Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"051ff4f9edbef1c762acc8f9","created_at":"2026-08-20T06:00:46.659Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"487c362f1c6e58d86369f891dcb46dcb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T06:00:46.670Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-051ff4f9edbef1c762acc8f9: start","job_status":"start","queue_duration_s":4.050018,"scheduling_latency_s":4.050053} gitlab # [ 449.919357] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:50.756Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0} gitlab # [ 449.924413] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:50.783Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"051ff4f9edbef1c762acc8f9","created_at":"2026-08-20T06:00:46.659Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"487c362f1c6e58d86369f891dcb46dcb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-08-20T06:00:46.670Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-051ff4f9edbef1c762acc8f9: done: 0.06283 sec","job_status":"done","queue_duration_s":4.050018,"scheduling_latency_s":4.050053,"redis_calls":9,"redis_duration_s":0.013996,"redis_read_bytes":7,"redis_write_bytes":1159,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004981,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007063,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001952,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018732,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.06283,"completed_at":"2026-08-20T06:00:50.783Z","load_balancing_strategy":"primary","db_duration_s":0.001489,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 449.983107] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:50.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckCiJobsWorker","jid":"132b050b568ec9bab9276fdd","created_at":"2026-08-20T06:00:46.683Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af96c29f93c6bcaeb13c4234061594ff","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:688518068b75df5544ce76496372eb2176b68f67fc20ec19a768c0a774774cd9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.708Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckCiJobsWorker JID-132b050b568ec9bab9276fdd: start","job_status":"start","queue_duration_s":4.084186,"scheduling_latency_s":4.084227} gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/592ba8e1ae809c278127a4883358e06e7303a2a1/statuses, in 0.22 seconds) (finished: subtest: eval and build post commit statuses, in 7.37 seconds) (finished: run the VM test script, in 521.68 seconds) gitlab # [ 450.234795] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:51.100Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"StuckCiJobsWorker","jid":"132b050b568ec9bab9276fdd","created_at":"2026-08-20T06:00:46.683Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"af96c29f93c6bcaeb13c4234061594ff","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:688518068b75df5544ce76496372eb2176b68f67fc20ec19a768c0a774774cd9","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.708Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"StuckCiJobsWorker JID-132b050b568ec9bab9276fdd: done: 0.308243 sec","job_status":"done","queue_duration_s":4.084186,"scheduling_latency_s":4.084227,"redis_calls":21,"redis_duration_s":0.04955,"redis_read_bytes":20,"redis_write_bytes":4659,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.014369,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1380,"redis_queues_calls":3,"redis_queues_duration_s":0.007445,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2316,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014505,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":502,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.013231,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":461,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.14075669999999998,"duration_s":0.308243,"completed_at":"2026-08-20T06:00:51.100Z","load_balancing_strategy":"primary","db_duration_s":0.108351,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60} gitlab # [ 450.369193] sidekiq-cluster[3499]: {"severity":"INFO","time":"2026-08-20T06:00:51.104Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"95c26a5fd6680d1eb072d421","created_at":"2026-08-20T06:00:46.739Z","trace_propagation_headers":{"sentry-trace":"004c7a1444d84cad98b0b2924884e492-dab9dbba03184c61","baggage":"sentry-trace_id=004c7a1444d84cad98b0b2924884e492,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"311794b3a3a3fe87d6caabb7962e5105","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-08-20T06:00:46.764Z","job_size_bytes":2,"pid":3499,"sidekiq_tid":"m8rb","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-95c26a5fd6680d1eb072d421: start","job_status":"start","queue_duration_s":4.340303,"scheduling_latency_s":4.340346} test script finished in 521.72s cleanup kill QemuMachine (pid 46) gitlab # [ 450.394861] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/08/20:06:00:51 +0000] "GET /api/v4/projects/root%2Ftest-flake/repqemu-system-aarch64: terminating on signal 15 from pid 39 (/nix/store/41m77i1296n33p6liin8ynr6wh3h6b7m-python3-3.14.6/bin/python3.14) gitlab # o (finished: cleanup, in 1.62 seconds) additionally exposed symbols: gitlab, vlan1, start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh [] [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-08-20T05:59:09.148Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'token_present': True, 'signing_token_present': False, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [] [{'id': 2, 'project_id': 1, 'number': 2, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '592ba8e1ae809c278127a4883358e06e7303a2a1', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-08-20T06:00:43.491124Z', 'started_at': None, 'finished_at': None}] [{'id': 5, 'sha': '592ba8e1ae809c278127a4883358e06e7303a2a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:00:43.969Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '592ba8e1ae809c278127a4883358e06e7303a2a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:00:43.969Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '592ba8e1ae809c278127a4883358e06e7303a2a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:00:43.969Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '592ba8e1ae809c278127a4883358e06e7303a2a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:00:43.969Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '592ba8e1ae809c278127a4883358e06e7303a2a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluating flake', 'created_at': '2026-08-20T06:00:43.969Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '592ba8e1ae809c278127a4883358e06e7303a2a1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-20T06:00:43.969Z', 'started_at': None, 'finished_at': '2026-08-20T06:00:49.602Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '592ba8e1ae809c278127a4883358e06e7303a2a1', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'building attributes', 'created_at': '2026-08-20T06:00:49.871Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}] [{'id': 5, 'sha': '592ba8e1ae809c278127a4883358e06e7303a2a1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-08-20T06:00:43.969Z', 'started_at': None, 'finished_at': '2026-08-20T06:00:49.602Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 6, 'sha': '592ba8e1ae809c278127a4883358e06e7303a2a1', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/2', 'description': '0 attributes built', 'created_at': '2026-08-20T06:00:49.871Z', 'started_at': None, 'finished_at': '2026-08-20T06:00:50.126Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 2, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]